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(54) Image data coding and restoring method and apparatus for coding and restoring the same 



(57) When encoding the continuous image by divid- 
ing the respective frames into a plurality of blocks, the 
image in the block in the present frame is compared with 
a corresponding image in the block in the same position 
of the reference frame and the amount of the changes 
of the predetermined image element within respective 
blocks it calculated. Only when the amount of change 
exceeds the predetermined threshold value, the image 
data of respective blocks is coded. A plurality of thresh- 
old values can be adapted and appropriately changed 
by considering spatially changing pattern of the amount 
of the change of the image with regard to the reference 
frame and a refreshing operation. 
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Description 

Background of the Invention 
5 Field of the Invention 

[0001 ] The present invention relates to an image data coding method of coding the image data with a high efficiency, 
an apparatus for coding an image data, a restoring method of decoding the coded image and an apparatus for restoring 
the same and more particularly to an image data coding and decoding method of dividing the image data into a plurality 
10 of blocks to produce the coded data of all the images related to the respective blocks obtained by dividing the image 
data. 

Description of the Related Art 

75 [0002] In the field of a television conference/television telephone involving colored static images and colored moving 
image, the image data whose information capacity is much greater than typical numerical data are used, and more par- 
ticularly, the data of the intermediate level of the image, or the colored image data requires high-speed and high quantity 
transmission. Therefore, it is necessary to process the coding of the values of the respective image elements with a 
high efficiency. 

20 [0003] The adaptive discrete cosine transform method is known as an example of an image data coding method with 
a high efficiency. 

[0004] This adaptive discrete cosine transform method (which is abbreviated as ADCT) divides the image into a plu- 
rality of blocks comprising, for example, 8x8 image elements, transforms the image signal of respective blocks into 
(two-dimensional DCT coefficients corresponding to the distributions of the space frequency by the two-dimensional 
25 discrete cosine transform), quantizes the two-dimensional DCT coefficient within a block obtained by the transform by 
using a threshold value suitable for vision, and then encodes the quantized coefficient by using a huffman table 
obtained statistically. 

[0005] The conventional coding device for the static image using the ADCT encodes the respective images sepa- 
rately, even if the respective values between images do not change greatly because of a close interrelation between 
30 them, for example, in the case of a moving image which is considered as a group of static images. 

[0006] Figure 1 shows an example of a structure of the conventional coding apparatus for a static image. 
[0007] A static image is divided into a plurality of blocks comprising 8x8 image elements, for example, and is inputted 
from the input terminal 1 1 and the respective image signals are sequentially restored in the input order to the block 
buffer 12. 

35 [0008] The two-dimensional DCT unit 13 reads the respective image signals from block buffer 12 by transforming the 
image signal corresponding to a plurality of image elements in respective blocks into the two-dimensional DCT coeffi- 
cient corresponding to the space frequency of the same number as the plurality of image elements by using the two- 
dimensional discrete cosine transform. 

[0009] Linear quantization unit 1 4 quantizes the dimensional DCT coefficient (matrix) of respective blocks by using 
40 the quantizing threshold value (quantizing matrix) which is suitable for vision and obtained from visual experimentation. 
The linear quantization unit 14 reads the quantizing threshold value from a quantizing threshold unit 15. 
[001 0] Variable length coding unit 1 6 performs a variable length coding of the quantization coefficient obtained by the 
linear quantizing unit 1 4 by using the Huffman coding table 1 7 obtained statistically, and outputs from the output termi- 
nal^ the coded data obtained from the variable length coding method. 
45 [001 1 ] In the variable length coding method, the quantizing coefficient (matrix) arranged in a two-dimensional manner 
is converted to a one-dimensional train of numerical values by using a scanning operation called zig-zag scanning and 
performs a variable length coding based on the difference between the head DCT coefficient of a block and the head 
DCT coefficient of the preceding block with regard to the DAC components. The value of the valid coefficients whose 
value is not zero is combined with the length of run (Run-length of the invalid coefficient whose value is zero), thereby 
so applying the variable length coding to respective blocks. 

[0012] Figure 2 shows a structure of a conventional restoring apparatus of the static image for restoring data coded 
by the above-recited variable length coding to the images. 

[0013] The data coded by the coding apparatus for the static image is inputted from the input terminal 21 to variable 
length restoring unit 22 in units of blocks. 
55 [0014] The variable length restoring unit 22 restores the quantizing coefficient of the DC component and AC compo- 
nents in the respective blocks using the Huffman coding table 17 (Huffman decoding table 27) which is used in the 
above variable length coding. 

[0015] Dequantization unit 23 converts the decoded quantization coefficient of respective DC component and AC 
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component into the two-dimensional DCT coefficients by using the quantized value 29 (quantized matrix). 
[0016] Inverse DCT transforming unit 24 performs the two-dimensional DCT transform by using the two-dimensional 
DC coefficient of the respective blocks which are decoded and restored as the image elements. 
[0017] The image signal of respective restored image element blocks is stored within the image memory 25 in units 
5 of blocks. 

[0018] An operation of the image signal of respective image elements at image blocks into the image memory 25 is 
controlled by inside-block image element writing controlling unit 26 and controls the block address generating unit 28 
and enables it to output an address of a block in which the image signal is to be written into the image memory 25 and 
performs a writing operation of the image signal of respective image elements of the present frame into the image mem- 
10 ory 25 in units of blocks. 

[0019] There is a method of coding a moving image which is subject to a consecutive scene, i.e. a television confer- 
ence or a television telephone system. Conventionally the respective images are subject to the methods of coding the 
moving images. 

[0020] Figure 3 shows a block diagram of a basic part of the moving image coding apparatus by using an interframe 
15 prediction coding method of utilizing a relation between the image in reference frame and the image in the present 
frame. 

[0021 ] The image of respective scenes of the moving image is inputted to difference image generating unit 32 through 
input terminal unit 31. 

[0022] The reference image, which is obtained by restoring the image in the preceding frame, is used as the image 
20 in the reference frame. 

[0023] The difference generating unit 32 obtains the difference image between the reference images stored in an 
image memory 33 and the present image (the image in the present frame) inputted from the input terminal 31 and 
stores the difference image in block buffer 34. The difference image can be obtained for respective blocks comprising 
image elements of 8 x 8, for example. Therefore, the block buffer 34 stores the difference image i.e difference block 
25 image between the block in the reference frame of 8 x 8 image element for example and the corresponding block in the 
present frame of 8 x 8 image elements with regard to the blocks in the same position. 

[0024] The two-dimensional DCT transform 35 applies the two-dimensional DCT transform to the difference block 
image of 8 x 8 image elements stored in the block buffer 34 obtains the 8 x 8 DCT coefficients, and thereby outputs them 
to quantization unit 36. 

30 [0025] Quantization unit 36 applies a linear quantization to 8 x 8 coefficients by using an equate threshold value appli- 
cable to an eyesight, thereby providing 8x8 quantized coefficients. 

[0026] The 8x8 quantization coefficients are subject to zig-zag scanning and is outputted to variable length coding 
unit 37 in the order of the DC component. AC components with a low space frequency AC components with relatively 
high space frequency. 

35 [0027] The variable coding unit 37 performs a variable length coding of the 8 x 8 input quantized coefficients by using 
Huffman coding table 38 and outputs the data coded by the variable length coding from the output terminal 40. 
[0028] The 8x8 quantizes coefficient matrix outputted from quantization unit 36 is inputted to the dequantization unit 
39 and the dequantization unit 39 restores it into the two-dimensional DCT coefficient matrix. 
[0029] Inverse two-dimensional DCT transform unit 41 performs the inverse two-dimensional DCT transform by using 

40 8x8 two-dimensional coefficients and restores the above difference block image 

[0030] The adding unit 42 adds the restored difference block image to the preceding image of the block in the same 
position in the reference image as in the position in the present block image and again rewrites the image obtained by 
the addition into the image memory 33. 

[0031 ] The above-recited sequential operation is applied to all the blocks of the image (the present image) of the new 
45 frame inputted from the input terminal 31 , thereby enabling the coded data of the difference image regarding all the 
blocks of the present image to be outputted from the output terminal 40. As discussed above, the image data of the 
present frame is not coded as it is and a difference image between the reference frame and the present frame is coded, 
thereby decreasing the amount of the coding. The same image as restored from the image of the present frame, which 
is restored based on the coded data of the difference image on the image restoring side, is stored in the image memory 
so 33 as the reference image to be used as the image of the reference frame when the image of the succeeding frame is 
inputted from the input terminal 31 . 

[0032] Figure 4 shows a principle structure of a conventional restoring apparatus of the moving image for restoring 
the image of the coded data outputted from the conventional coding device for the moving image. 
[0033] A variable length restoring unit 52 inputs the coded data obtained by applying a variable length coding to the 
55 difference image in units of block from the input terminal 51 and restores the coded data into quantization coefficients 
in units of blocks by using Huffman coding table 58 , which is the same as the Huffman coding table 38 in the conven- 
tional coding apparatus for the moving image. 

[0034] Dequantization unit 53 performs a dequantization of quantization coefficients of respective blocks by using the 
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same matrix as used in the quantization units 39 in the coding apparatus for the moving image, and restores the two- 
dimensional DCT coefficients of respective blocks. 

[0035] Inverse two-dimensional DCT transforming unit 54 restores the difference image of respective blocks by per- 
forming the inverse two-dimensional DCT conversion in units of blocks by using the two-c5mensional DCT coefficient 

5 matrixes of respective blocks. 

[0036] Adding unit 55 adds the decoded difference image of respective blocks to the image in the block in the same 
position in image memory 56 and the image obtained by this adding operation is rewritten in image memory 56. 
[0037] A writing operation of a restored image into image memory 56 for respective blocks is controlled by intra-block 
image element write controlling unit 57. Intra-block image element write controlling unit 57 controls block address gen- 

w erating unit 59 and outputs an address of the particular block which is stored in the image memory and to which the 
difference image is added, to image memory 56 from block address generating unit 59 , thereby writing the restoration 
image of respective frames in the image memory 56 in units of blocks. 

[0038] The above sequential process is applied to the coded data of the difference image of all blocks of respective 
frames of the image and thus image memory 56 stores the restoration image of respective frames. 

is [0039] However, the above recited conventional technology has the following problems. 

[0040] In the conventional coding technology of the static image, even respective images having small variation 
between consecutive images are independently coded. Thus the conventional coding technology can be realized in a 
small scale circuit. However, even if the variation between the consecutive images is very small such as images for a 
moving or a television telephone having a camera fixed, the compression ratio cannot be increased. 

20 [0041 ] When the coding technology for the moving image as shown in Figure 3 is used, the compression ratio.can be 
raised owing to the difference coding method but it requires a larger scale of apparatus. In the conventional coding 
apparatus for the moving image, the difference image between the present frame and the reference frame is calculated 
and the image of the reference frame to be used for obtaining the difference image is stored in the image memory 33. 
The variable length coding to the above ADCT is irreversible coding (information loss coding) and thus the error of the 

25 difference image from the original image becomes large when the number of accumulations exceeds a predetermined 
number and thus the quality of the image stored in the image memory 33 is decreased evidently. Therefore, it is neces- 
sary to refresh the image in an intra-frame mode at a predetermined number of frame intervals. 
[0042] The intra-frame mode performs a variable length coding of the input image according to the ADCT in the similar 
manner to the conventional coding apparatus for the static image. 

30 [0043] When the inverse two-dimensional DCT transform unit 54 used in the conventional decoding apparatus of the 
moving image is different from the inverse two-dimensional DCT transform unit 41 used in the conventional coding 
apparatus for the moving image in respect of an operation or operation method, the errors generated in coding opera- 
tions are stored and accumulated in the image memories 33 and 56, and the noise caused by the accumulated errors 
becomes evident. Therefore, CCITT recommendation H-261 recommends that a refreshing operation should be per- 

35 formed at least once by using the above intra-frame mode during the period of 132 coding operations to solve the above 
problem of the accumulated errors generated due to a mis-match between the inverse two-dimensional DCT transform 
unit 41 and 54 in both apparatuses. 

[0044] In the intra-frame mode, the image data of all blocks of one frame is coded as it is and the coded data of all 
blocks of one frame are transmitted to the receiving side. The frame in which such a coding is performed is called a 
40 refresh frame and such a coding is called refreshing. A quantity of the coding of the refresh frame in which the image 
data of all the blocks of one frame are coded as is, is greatly different from the quantity of coding of the ordinary frame 
in which only the difference image is coded. Namely, a quantity of the coding of the refresh frame is usually larger than 
that of the ordinary frames. 

[0045] Therefore, when the image is transmitted by performing the data compression using such a high efficiency cod- 
45 ing method as described above in television conference or a television telephone, the receiver of the coded data 
restores the frame after a longer time period passes upon receipt of the coded data of the refreshing frame than upon 
receipt of the coded data of an ordinary frame. 

[0046] This rjfference in receiving time causes a receiver of the image to feel it naturally long. 
[0047] When the image is transmitted at ten frames per second through an ISDN (Integrated Service Digital Network) 
so with the transmission rate of 64Kbps provided by a Japanese Telecommunication and Telephone Company, the amount 
of coded data of one frame should be less than 6400 bits. 

[0048] Generally speaking, a quantity of coded data of one frame in the case of the ordinary frame can be com- 
pressed less than 6400 bits but the quantity of the coded data of one frame in the case of the refreshed frame is some- 
times more than 6400 bits. 

55 [0049] When a quantity of coded data per one frame exceeds the maximum quantity of coded data (which is 6400 
bits in this case) of one frame which is originally assigned to one frame, the transmission processing of the refresh 
frame cannot be completed within the processing time assigned to the refresh frame and is extended into the process- 
ing time of the next frame. 
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[0050] In this case, the coding process of the next frame is not performed and the transmission process of the refresh 
frame will be performed. As a result the frame which is not subject to the coding process is not transmitted to the receiv- 
ing side and the monitor screen on the receiving side is displayed with one frame missing. 
[0051] This example is shown in Figure 5. 
5 [0052] In Figure 5, the third frame is a refresh frame and quantity of the coded data of the refresh frame exceeds 6400 
bits. Therefore, the image of the third frame is not restored at time T3 when the image of the third frame should be 
restored on the monitor screen in the receiving side. An image of the third frame is restored at time T4, at which the 
image of the fourth frame should be restored. Thus, the image of the frames following the fourth frame are restored with 
one frame delay. 

10 [0053] In the case of transferring the moving image, the coding side and decocfing side have the coding buffers. 
[0054] These code buffers are respectively provided in a succeeding stage of the variable length coding unit 37 and 
in a preceding stage of the variable length decoding unit 52 as shown in Figures 3 and 4. These code buffers have to 
store.the data when the refreshing operation is performed, and thus the capacity of these code buffers depend on the 
maximum amount of the data of one frame, namely, the amount of data required for the refreshing operation. Accord- 

is ingly, the decrease of the capacity of these code buffers greatly contributes to realization of a small size and inexpensive 
coding and decoding apparatus. 

[0055] When the refreshing operation is performed, the image data of all the blocks of the refresh frame are coded 
without being subject to any process, as recited above and thus the amount of the coded data in the refreshing frame 
is greater than that in the ordinary frame which updates only the difference image. Therefore, there is a problem that a 
20 time spent to update the reference frame upon performing the refreshing operation becomes longer than that to update 
the reference frame upon coding the ordinary frame. 

[0056] The variation between two consecutive frames in the moving image depends on the kind of the image. There- 
fore, upon performing the refreshing operation, the amount of the data is increased in the case of the image with a large 
movement and thus the refreshing operation sometimes cannot satisfy various conditions of the transmission line such 
25 as an information transmitting rate and the numb®- of frames transmitted per unit time. 

[0057] There is also a problem that the image appears strange as if it flashes at the time of the refreshing operation 
since a large amount of errors compared to the original image is accumulated in the image data of the reference frame 
before the refreshing operation is applied to the reference frame. 

30 Summary of the Invention 

[0058] An object of the present invention is to provide an image data proceeding method and apparatus for coding 
and decoding consecutive images in which variation between two consecutive images is small by using a small scale 
circuit with a high efficiency apparatus performing the same. 
35 [0059] Another object of the present invention is to display the refresh frame having a large amount of coded data by 
using a code buffer of a small size so that the receiver does not feel or recognize a waiting time even in the case of the 
refresh frame. 

[0060] A further object of the present invention is to update the reference frame at a high speed when the refresh 
operation is performed. 

40 [0061] A further more object of the present invention is to transmit the image in an optimum manner in accordance 
with various conditions such as an information transmission rate of the transmission line and the number of frames to 
be transmitted per unit time with regard to respective frames. 

[0062] A still further object of the present invention is to enable the refreshment operation so that it can be performed 
without causing the refreshing frame to appear strange. 

45 [0063] The present invention provides an image data coding method for coding image data in units of blocks by divid- 
ing a frame into a plurality of blocks comprising a step for comparing the image data in the block in the present frame 
corresponding to the image data in the block in the same position of the reference frame and determining the existence 
of change in the image in the block of the present frame compared to the corresponding image in the block in the same 
position of the reference frame, and a step for outputting the block information designating a valid block in which the 

so image changes from the reference frame or an invalid block in which the image does not change from the reference 
frame, and a step for decoding only the image data of a valid block. 

[0064] Therefore, the present invention encodes only the image data of the vaOd block whereby the image changes 
from the reference frame and thus the amount of coded data in the consecutive image, such as the moving image 
including many background portions which does not change in the image can be decreased. 
55 [0065] The present invention is a method for decoding the image data from the coded data of the image data gener- 
ated by the above image data encoding method and the block information wherein said method comprises a step for 
decoding the image data of the valid block from the coded data, a step for updating the address of the image memory 
in which the image data of the valid block is to be written, based on the content of the block information and a step for 
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writing the decoded image data of the valid block in the image memory in accordance with the updated address. 
[0066] The present invention decodes only the image data of the valid block and writes the decoded image data to a 
corresponding area of the image memory, thereby enabling image data to be decoded efficiently. 
[0067] The present invention provides a method for encoding the consecutive image data by encoding a refresh 

5 frame, by dividing it into a plurality of portions. 

[0068] The present invention provides a method for encoding the image data by a first step of comparing the image 
data in the block in the present frame with corresponding image data in the block in the same position in the reference 
frame and determining the existence of change in the image in the block of the present frame compared to the corre- 
sponding image in the block in the same position in the reference frame, a second step for encoding the valid block of 

10 the present frame which is determined as having the change in the image from the reference frame in the first step 
when the present frame is not a refresh frame, and the third step of encoding the valid block of the reference frame and 
encoding the invalid block of the present frame in which the image is determined as not having the change from the ref- 
erence frame in the first step after the completion of the encoding of the valid block when the present frame is a refresh 
frame. 

is [0069] When the refresh frame is encoded, only the valid block which has great affect on the decoded image is first 
encoded and then all the invalid blocks are encoded after the completion of all the valid blocks. Therefore, it can decode 
the refresh frame in a more natural manner than in the conventional art even if the amount of the codes in the refresh 
frame is plentiful, thereby decreasing the capacity of both on the coding side and decoding side. 
[0070] The present invention provides a method of decoding an image data to decode the consecutive image data 

20 comprising a first step of determining the existence of change in the image in the block in the present frame compared 
to the corresponding image in the block in the reference frame, a second step of encoding only the valid block of the 
presem frame which is determined as having the change in the image from the reference frame in accordance with the 
first step when the frame is not a refresh frame, a third step of encoding a valid block of the present frame and then 
encoding the invalid block of the present frame which is determined as not having the change in the image from the ref- 

25 erence frame in accordance with a first step at the completion of the decoding and encoding operations, when the 
present frame is the refresh frame, a fourth step of updating the image data in the block in the reference frame com- 
pared to the corresponding image data in the valid block in the present frame to the valid block of the coded present 
frame after the completion of the second step and a fifth step of switching the image data of the present frame to the 
image data of the reference frame after the completion of the third step. 

30 [0071 ] Therefore, the present invention switches the image frame of the present frame to the image data in the refer- 
ence frame in accordance with the fifth step when the coding of the refresh frame is completed in the third step and thus 
can update the reference frame upon a refreshing operation at a high speed. 

[0072] The present invention provides an image data coding method of coding consecutive image data comprising a 
first step of obtaining the amount of change of the value of the predetermined image element in the block in the present 

35 frame compared to the corresponding image element in the block in the same position of the reference frame, compar- 
ing the amount of the change with the predetermined threshold value and determining the existence of the change of 
the image between the block in the present frame compared to the corresponding image in the block in the same posi- 
tion with the reference frame, a second step of coding only the valid block of the present frame which is determined as 
having the change in the image from the reference frame in accordance with the first step, a third step of determining 

40 whether the threshold value obtained with the first step, a third step of determining whether the threshold value obtained 
in the first step is appropriate, based on the quantity of the coded data obtained by the second step and changing the 
threshold value to another value when the threshold value is not appropriate one. thereby repeating the first and second 
steps until it is determined in the third step that the threshold value is appropriate. 

[0073] The present invention provides a method of encocfing the image data comprising a first step of obtaining the 
45 amount of change of the value of the predetermined image element in the block in the present frame compared to the 
corresponding image in the block at the same position of the reference frame, comparing the amount of the change with 
the predetermined threshold value and determining the existence of the change of the image in the block in the present 
frame compared to the corresponding image in the block in the same position of the reference frame, a second step of 
determining whether the threshold value used in the first step is appropriate, based on the above valid block of the 
so present frame which is determined as having the change in the frame from the reference frame in the first step or that 
of the invalid block in the reference frame which is determined as having the change in the reference frame in the first 
step or that of the invalid block in the present frame which is determined as not having the change in the image from 
the reference frame, and changing the threshold value to another value when the threshold value is not appropriate, a 
third step for decoding the block of the present frame which is determined as the valid block in the first step and whose 
55 threshold value is determined as being appropriate in the second step, thereby performing the first step when the 
threshold value is again determined in the second step. 

[0074] The present invention repeats the process of changing the threshold value to be used to determine whether 
the amount of the image data of the present frame, the number of valid blocks of the present frame or the number of the 
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invalid blocks, based on the quantity of the whole image data of the present frame which is determined as the valid block 
or invalid block until the quantity of the code, the number of valid blocks or that of the invalid blocks are determined as 
appropriate and outputs the coded data when they are determined to be appropriate by the determining step, thereby 
being capable of coding the appropriate quantity of the coding can be achieved in accordance with a quantity of the 

5 image corresponding to the image data and a transmission line capacity. 

[0075] The present invention provides a method of encoding the image data comprises a first step of obtaining the 
amount of the change of the determination image element forming the reference by which the existence of the change 
of the image in the block in the present frame compared to the corresponding image in the block in the same position 
in the reference frame is determined and preparing frames of the present frame with regard to the amount of the 

10 images, a second step of determining the threshold value to be used to determine the existence of change of the image 
in the block in the present frame compared to the block in the same position of the reference frame, based on the his- 
togram obtained through the first step, a third step for obtaining the amount of the change of the value of the image data 
predetermined in the block in the present frame compared to the corresponding image in the block in the same position 
of the reference frame, comparing the amount of the change with the determining threshold value provided in the sec- 

75 ond step and detecting the existence of change of the image in the block in the present frame compared to the image 
in the reference frame, and fourth step of encoding only the image data of the valid block which is determined as change 
in the image from the reference frame in accordance with the third step with regard to all the blocks of the present frame. 
[0076] Therefore, the present invention can transmit an optimum image in accordance with the condition of the 
number of the transmitted frames are units. 

20 [0077] The present invention provides the coding image data in units of blocks by dividing frame into a plurality of 
blocks comprising a step of obtaining the change of the value of the predetermined image element in the block in the 
present frame oompared to the image in the same position of the reference frame, comparing the amount of the change 
of the respective blocks of the present frame determining the threshold value and determining whether block of the 
present frame is valid block in which the image changes from the reference frame, a step of changing the determination 

25 in accordance with the result of determination, and step of coding the image data of the blocks which are determined 
as the valid blocks in the above determination process. 

[0078] The present invention changes the magnitude of the threshold value for detecting the change of the image 
depending on whether the block of the present frame changes from that of the reference frame. Therefore it can deter- 
mine a starting and ending in the block image change in the consecutive region of the image change appropriately even 
30 if the amount of the change of the image is not uniform in respective blocks in the region in which the image changes 
continuously with regard to the reference frame. It can decode the image of the consecutive region in which the amount 
of the change of the image is not formed in a natural manner. 

Brief Description of the Drawings 

35 

[0079] One skilled in the art can easily understand additional features and objects of this invention from the descrip- 
tion of the preferred embodiments and some of the attached drawings. In the drawings: 

Figure 1 shows a block diagram of a structure of the conventional coding apparatus of the static image; 
40 Figure 2 shows a block diagram of a structure of conventional decoding apparatus of the static image; 

Figure 3 shows a block diagram of a structure of a basic concept of the conventional coding apparatus for the mov- 
ing image; 

Figure 4 shows a block diagram of a structure of the principle portion of the conventional decoding apparatus for 
the moving image; 

45 Figure 5 shows a view for explaining the problem of the conventional data coding method; 

Figure 6 shows a view for explaining the first image data coding method according to an embodiment of the present 
invention; 

Figure 7 shows a flow chart for explaining the first image data decoding method according to an embodiment of the 
present invention; 

so Figure 8 shows a block diagram of a circuit of the first image data coding apparatus according to an embodiment 
of the present invention; 

Figures 9A to 9C show an embodiment of the block variation determining unit; 
Figure 10 shows a format of coded data output from the first image data coding apparatus; 
Figure 1 1 shows a circuit structure of the first image data restoring unit for restoring the coded data produced by 
55 the first image data coding apparatus into the image data; 

Figure 1 2 shows a circuit block diagram of an internal arrangement of the above-described address calculating unit; 
Figure 1 3 shows a schematic circuit block diagram for showing an overall arrangement of a second image data cod- 
ing apparatus according to another currently preferred embodiment of the present invention; 
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Figure 14 shows a format of multiplexer first outputs the coded data produced by the second image data coding 
apparatus; 

Figure 15 shows a schematic circuit block diagram for showing an overall arrangement of a second image data 
decoding apparatus according to the present invention; 
5 Figure 1 6 shows a schematic circuit block diagram for showing an entire arrangement of a third image data coding 
apparatus according to the present invention; 

Figure 17 shows a circuit block diagram of an overall arrangement of a third image data decoding apparatus 
according to another currently preferred embodiment of the present invention; 

Figure 18 is a flowchart indicating the 2nd image data encoding method according to an embodiment of the present 
w invention; 

Figure 19 is a block diagram showing the circuit configuration of the 4th image data encoding device according to 
an embodiment of the present invention; 

Figure 20 fe a Uock diagram showing an example of the circuit configuration of the encoding unit in the 4th image 
data encoding device; 

15 Figures 21 A to 21 E show an explanatory view of a practical operation of the 4th through 7th image data encoding 
devices according to an embodiment of the present invention; 

Figures 22A to 22D show an explanatory view of an operation of the 4th through 7th image data encoding devices 
according to an embodiment of the present invention; 

Figures 23A to 23F show an explanatory view of another operation of the 4th through 7th image data encoding 
so devices according to an embodiment of the present invention ; 

Figure 24 shows a flowchart indicating the 3rd image data encoding method according to an embodiment of the 
present invention; 

Figure 25 is a block diagram showing the circuit configuration of the 5th image data encoding device according to 
the embodiment of the present invention; 
25 Figure 26 is a flowchart indicating the 4th image data encoding method according to an embodiment of the present 
invention; 

Figure 27 is a block diagram showing the circuit configuration of the 6th image data encoding device according to 
the embodiment ol the present invention; 

Figure 28 is a flowchart indicating the 5th image data encoding method according to an embodiment of the present 
30 invention; 

Figure 29 is a block diagram showing the circuit configuration of the 7th image data encoding device according to 
the embodiment of the present invention; 

Figure 30 shows a block diagram indicating the configurations of the 8th and 9th image data encoding devices 

according to the present invention; 
35 Figure 31 shows a block diagram showing the configuration of the 10th image data encoding device; 

Figure 32 shows a block diagram showing the configuration of the 1 1 th image data encoding device; 

Figure 33 shows a block diagram showing the configuration of the 12th image data encoding device; 

Figure 34 shows a block diagram showing the configuration of the 13th image data encoding device; 

Figure 35 shows a block diagram showing the configuration of the 14th image data encoding device; 
40 Figure 36 shows a block diagram indicating an aspect of the determination threshold output unit in the 1 4th image 

data encoding device; 

Figure 37 shows a block diagram indicating another aspect of the above described determination threshold output 
unit in the 14th image data encoding device; 

Figure 38 shows a flowchart indicating the 6th image data encoding method as an embodiment of the present 
45 invention; 

Figure 39 shows an explanatory view of decoding reference frame when the 6th image data encoding method is 
used; 

Figure 40 shows a block diagram indicating the circuit configuration of the 15th image data encoding device for 
encoding image data according to the 6th image data encoding method; 
so Figure 41 shows a block diagram indicating the circuit configuration of the 16th image data encoding device for 
encoding image data according to the encoding method indicated in the flowchart; 

Figure 42 shows an example of a configuration of the encoding unit in the 15th and 16th image data encoding 
device; 

Figure 43 shows a flowchart indicating the 7th image data encoding method; 
55 Figure 44 shows a circuit configuration of the 1 7th image data encoding device for encoding image data according 
to the encoding method indicated in the flowchart; 

Figure 45 shows a flowchart indicating the important operation of the 8th image data encoding method according 
to the embodiment; 
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Figure 46 shows a block diagram showing the main part of the circuit of the 18th image data encoding device; 
Figure 47 shows a configuration of the 19th image data encoding device for encoding image data in each frame 
according to the above described method II; 

Figure 48 shows a configuration of the 20th image data encoding device for encoding image data in each frame 
5 according to the above described method III; 

Figure 49 shows a configuration of the 21st image data encoding device for encoding image data in each frame 
according to the above described method III; 

Figure 50 shows a flowchart explaining the 9th image data encoding method according to the above described 
embodiment; 

10 Figure 51 shows a block diagram showing the circuit configuration of the 22nd image data encoding device; 

Figure 52 shows a block diagram showing another configuration of the 23th image data encoding device encoding 
image data according to the method indicated by the flowchart; 

Figure 53 shows a flowchart indicating the 10th image data encoding method according to the above described 
embodiment; 

15 Figure 54 shows a flowchart indicating the 1 1th image data encoding method; 

Figure 55 shows a flowchart indicating the 12th image data encoding method according to further embodiment of 
the present invention; 

Figure 56 shows a block diagram indicating the configuration of the 24th image data encoding device; and 
Figures 57A to 57C show each of the configuration examples of the determination threshold output unit in the 24th 
20 image data encoding device. 

Description of the Preferred Embodiment 

[0080] The embodiment of the present invention will be explained by referring to the drawings. 

25 [0081 J Figure 6 shows an explanatory view of the first image data coding method according to an embodiment of the 
present invention. The first image data coding unit divides the image data of one frame comprising m x n image ele- 
ments into a plurality of blocks (where m and n are integers), and performs a coding of the image elements of blocks. 
[0082] In Figure 6, the image element in the first block of the present frame is compared with the image element of 
the first block of the preceding frame with the position of the image element and block of the present frame being the 

30 same as those of the preceding frame, thereby determining whether the first block of the present frame is a valid block 
in which the image is different from that in the first block of the preceding frame (S1 , S2). 

[0083] The determination as to whether it is a valid block is performed based on using the following methods (1), (2), 
and (3). 

35 (1) The sum of the absolute value of the difference between the value (for example, brightness level value) of the 
image element in the present frame and the present frame is obtained and the block with the sum value of the cor- 
responding image elements in the same position in the preceding frame larger than the predetermined threshold 
value is deemed a Valid block". According to this method (1), the valid block is determined based on the total sum 
of the absolute values of the differences between the corresponding image elements and thus a variation of the 

40 whole one block can be examined. 

(2) The absolute values of the difference of all the image elements are obtained for respective blocks of the present 
frame. The block in which the maximum value of absolute values of the difference is more than the specified value 
can be deemed a "valid block'. This method (2) has only to detect the absolute values of the difference and thus 
determines the "valid value" with a simple circuit at a high rate processing. 

45 (3) The total sum of the squares of the difference between the value of the image element in the block in the present 
frame and the value of the corresponding image element in the corresponding block in the same position in the pre- 
ceding frame and only the block whose total sum exceeds the predetermined threshold value is deemed a "valid 
block". In this method (3), the variation of the image elements is based on the total sum of the squares of the dif- 
ference and thus the amount of the variation is emphasized. Therefore, the variation within one block can be exam- 

50 ined from a view point of its effect on an eyesight with accuracy. 

[0084] Hereinafter, a block which is not a valid block, namely, in which the image data does not change from that of 
the preceding frame is expressed as an invalid block. 

[0085] "me result of the determination of the first block is outputted as block information representing whether the 
55 block is a valid block (S3) . Sequentially, it is determined based on the determination result at step S2 whether the image 
data of the first block changes from the preceding frame (S4). 

[0086] When the image data of the present frame changes from that of the preceding frame, the image data of the 
first block is coded (S5), where the first block of the present frame is determined as a valid block. If the image of the first 
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block does not change from that of the preceding frame in step S4, the image data of the block is not coded. 
[0087] The above processes S1 to S5 are repeated with regard to all the blocks following the first block of the present 
frame, the block information designating the valid block or the invalid block is outputted for all the blocks of the present 
frame and only the image data of the blocks which are determined as being a valid block in the present frame are coded. 

5 [0088] When the above processes S1 to S5 are determined as being completed with regard to all the blocks of the 
present frames in step (S6, YES), the coding of the image data of the present frame is completed. 
[0089] In step S5, the coding may be performed by using an orthogonal transform such as ADCT. By adopting such 
an orthogonal transform, a circuit scale of the coder may be made small, and the compression ratio can be increased. 
The block information in step S3 may be outputted to the information holding unit in the coding device. When the coding 

w is completed for all the blocks of the present frame, the block information of all the blocks held in the information holding 
unit may be outputted with the coded data of the valid blocks. 

[0090] When the coded data of the valid blocks is outputted, the number of consecutive appearance of the invalid 
blocks up to the.next appearance of a valid block is calculated and the number of calculated values of the consecutive 
appearance of the invalid blocks may be outputted as the block information following the coding data, thereby decreas- 

15 ing the amount of the data of the block in the frame informatioa 

[0091 ] The block information may be coded thereby for output after it has been compressed. 
[0092] As described above, in the image data coding method according to the first embodiment only the image data 
of the valid block in which the image data in the block in the present frame changes from the corresponding one in the 
corresponding block in the preceding frame is selected and encoded, and thus the amount of the coded data can be 

20 reduced greatly in the case of the frame including a large background portion in which the image does not change. 
[0093] As the existence of the change of the image data in the block in the present frame from the corresponding 
image data in the preceding frame is outputted as the block information, the image data restoring side can easily deter- 
mine the block in which the image changes, thereby accurately restoring the image data. 

[0094] Figure 7 shows a flow chart for explaining the first image data decoding method according to an embodment 
25 of the present invention. 

[0095] The decoding method designated by a first image data coding method decodes the coded data to the image 
data. According to this method, it is determined based on the block information whether each of respective blocks of the 
frame in which the image is to be restored is a valid block (Si 1). 

[0096] When the block is the valid block, the coded data of the block is restored to the image data (S1 2). The restored 
30 image data (restored block image) is written into the predetermined block address of the image memory (S13). Then, 
the write address of the image memory is updated to the address of the block which should be the next subject of the 
restoration (S1 4). 

[0097] In step S1 2, the block is determined as an invalid block, the write address for the restoration image is updated 
to the write address of the restoration of the next block (S15). The above steps (S1 1 - S15) are repeated in the prede- 
35 termined sequence with regard to all the blocks of the restoration frame and when it is determined yes that the restora- 
tion of the image data is completed for ail the blocks (S1 6, YES), the restoration operation of the image data of all the 
blocks within one frame is completed. 

[0098] According to the first image data decoding method, only the image data of the valid block is restored based on 
the input block information and after the restoration, the image data of the block address corresponding to the valid 
40 block in the image memory is updated to the restored image data. With regard to the invalid block whose image data 
does not change from that of the prececfing frame, the restoration of the image data is not performed and the block 
address of the image memory is merely updated. Therefore, this method can restore the image data of one frame with 
a high efficiency at a high speed. 

[0099] Figure 8 shows a block diagram of a circuit of the first image data coding apparatus according to an embodi- 

45 ment of the present invention. 

[0100] In Figure 8, block buffer 610 sequentially stores the image data of respective blocks of the input present frame 
in units of blocks. Image buffer 612 stores the image data of the reference frame to be used as the image data of the 
preceding frame with regard to the image data of respective frames which are inputted sequentially. 
[0101 ] Variation amount calculating unit 614 compares the image element in the block in the present frame to the cor- 

50 responding image element in the blocks of the reference stored in the image buffer 612 and calculates the amount of 
the variation of the value of the image elements per block. 

[01 02] Block variation determining unit 61 6 compares the variation amount of the image elements of respective blocks 
inputted and calculated by the variation calculating unit 614 with the satisfactory value stored in the threshold value stor- 
ing unit 616a and determines whether the image of respective input blocks changes from that of the reference frame. 
55 When there is a valid block whose image changes from the reference frame, the block variation determining unit 616 
outputs "1 " and when there is an invalid block image which does not change from the reference frame, ft produces "0" 
as the decision determination signal. 

[01 03] Switch 618 outputs the image data of the present block stored in block buffer 61 0 to the two-dimensional DCT 
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transform unit 620 and image buffer 612 in accordance with the determination result signal inputted from block deter- 
mining unit 616. Namely, when the block determining unit 616 produces the decision result signal designating that the 
present block is the valid block, the image data of the present block held in the block buffer 610 is outputted to the two- 
dimensional DCT transform unit 622 and image buffer 612. 
5 [0104] Image buffer 612 rewrites to the data in the present frame the image data in the block held in the reference 
frame which is provided in the same position as that of the present block 

[01 05] Block information holding unit 620 holds variation determining information of all the blocks of the present frame 
inputted from the block variation determining unit 616, namely, "1" in the case of the valid block and H 0" in the case of 
invalid block 

10 [0106] Two-dimensional DCT transform unit 622 performs an orthogonal transform of the image data of respective 
blocks of the present frame inputted from the switch 618 using the two-dimensional discrete cosine transform, thereby 
providing the two-dimensional DCT coefficients of the special distribution, the number of the DCT whose number is 
equal to the coefficients number of the image elements in the block, quantizes the two-dimensional DCT coefficient of 
respective blocks by using the quantizing threshold value which is obtained by visual experimentation and is adapted 

is to the vision and is held quantization threshold value holding unit 624a. 

[0107] Variable length coding unit 626 encodes the quantized coefficient obtained by quantization unit 624 by using 
the huffman code table stored in the huffman coding data which is obtained statistically. The coded data obtained by 
this variable coding method is outputted to the coded data holding unit 628. 

[0108] In this variable coding method, the quantizing coefficient arranged in two-dimensional manner is converted to 
20 the one-dimensional train of numerals by a scanning process called a zigzag scan. As to the DC component, the differ- 
ence between the DC component at the head of present block and that of the head of the preceding block is subject to 
the variable length coding. As to the AC component, the value of the valid coefficient (whose value is not zero) is com- 
bined with the length of run (run length) of the invalid coefficients whose values are zero obtained up to the next valid 
coefficient, thereby being subjected to a variable length coding for respective blocks. The code data holding unit 628 
25 stores one frame of the coded data of the present frame inputted from the variable length coding unit 626. 

[01 09] Multiplexer MPX 630 selectively outputs the block information of the present frame held in the block information 
holding unit 620 and the coded data of all the blocks of the present frame are stored in the coded data holding unit 628. 
[0110] Figures 9A to 9C show an embodiment of the block variation determining unit 6 1 6. 
[0111] Figure 9A shows a block diagram of a circuit structure according to one embodiment of the block variation 
30 determining unit 616. Variable absolute value calculating unit 6160 calculates the absolute value of the variation of the 
image elements value which is inputted from the variation amount calculating unit 614 and which is determined based 
on the image value at the same position as that in the reference frame with regard to the respective image elements of 
respective blocks. 

[01 1 2] Intra-block maximum value detecting unit 61 62 detects the maximum value A of the absolute value of respec- 
35 tive blocks from the absolute value of the variation amount of the image element value of respective image elements of 
respective blocks inputted from the absolute value calculating unit 6160. 

[011 3] Threshold holding unit 616a stores the threshold value T1 for determining the invalid/valid block (existence of 

the variation/non-existence of the variation) with regard to respective blocks of the present frame. 

[01 14] When the calculation of the variation amount of the image element value regarding all the image elements of 

40 a block is completed by the absolute value calculating unit 61 20, the comparing unit 61 24 compares the maximum var- 
iation value A in the block which is detected by intra-block maximum value detecting unit 6122 with the threshold value 
T held in the threshold holding unit 616a and determines the block in which the image changes from the reference 
frame, namely, the valid block when the maximum variation value A is larger than the threshold value T1 , thereby out- 
putting "1". The comparing unit 6124 determines the block as the block in which the image does not change front the 

45 reference frame, namely, the invalid block if the maximum variation value A is less than the threshold value T1 , thereby 
outputting "0" to the switch 61 8 and the block information holding unit 620. 

[01 1 5] The embodiment can determine whether the image has valid from the reference frame with regard to respec- 
tive blocks by using a simple circuit as only the absolute value of the variation amount of respective image elements of 
the blocks need to be detected. 
so [01 1 6] Figure 9B shows a block diagram of a circuit structure according to the second embodiment of the block vari- 
ation determining unit 616. In Figure 9B, the absolute value calculating unit 6120 and the comparing unit 6124 are the 
same as those in the first embodiment. 

[01 1 7] intra-block accumulating unit 61 26 accumulates the absolute value of the variation of the image element input- 
ted from the absolute value calculating unit 6120 and outputs the amount of the variation of the respective image ele- 
55 ment value of all the image elements in respective blocks which are obtained through the above calculation and 
outputted to comparing unit 6124. 

[01 1 8] Threshold holding unit 61 6a stores the accumulated threshold value T2 for determining the valid/invalid block 
(existence of change of the image/non-existence of change of the image) with regard to respective blocks of the present 
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frame. 

[0119] When the absolute value calculating unit 6120 completes the above calculation for one block and completes 
of the calculation of the accumulation value B, the variation of the image element value of all the image elements of the 
particular block is completed by the accumulating unit 6126, the comparing unit 6124 compares the accumulated value 

5 B with the accumulation threshold value T2 held by the threshold holding unit 616a. When the accumulated value B is 
more than the accumulation threshold value T2, the comparing unit 6124 determines that the image varies from the ref- 
erence frame with regard to the block, thereby outputting "1 " and when the accumulation value B is less than the accu- 
mulation threshold value T2, the comparing unit 6124 determines that the block does not carry any variation, namely, 
is the invalid block, thereby outputting "0" to the switch 61 8 and the block information holding unit 620. This embodiment 

io determines the valid block or invalid block based on the accumulated value of the absolute variation value of all the 
image elements within one block, thereby checking the variation or the whole block. 

[0120] Figure 9C shows a block diagram of a circuit structure according to the third embodiment of the block variation 
determining unit 616. In Figure 9G. the comparing unit 6124 is the same as that in the first and second embodiments. 
The second power calculating unit 61 28 calculates the square of the variation of the image element value inputted from 
75 the variation and calculating unit 614. 

[0121] Intra-block accumulating and adding unit 6130 accumulates the square inputted from the square calculating 
unit 6128 in units of blocks and calculates the accumulation value of the square for all the image elements within one 
block. 

[0122] The threshold value holding unit 1 2a stores the accumulation threshold value T3 for determining the changed 
20 (i.e.valid)/ unchanged (i.e. invalid) block (existence of variation in the image/hon-existence of variation in the image) with 
regard to the respective blocks of the present frame. 

[0123] Second power calculating unit 6128 completes the calculation of the square and intra-block accumulating unit 
6130 completes the accumulation calculation of the square of all the image elements in a particular block, comparing 
unit 6124 compares the accumulation value T3 held in the accumulation holding unit 616a with the accumulation value 
25 C of the square of the variation of all the image elements in the block subject to the calculation of the intra-block accu- 
mulating unit 6130 and determines that-the valid block when the accumulation value C is larger than the accumulation 
threshold value T3. thereby outputting "1" and determines that the block is an invalid block, when the accumulation 
value C is less than the accumulation threshold value T3 thereby outputting "0" to the switch 618 and the block informa- 
tion holding unit 620. 

30 [0124] The third embodiment can determine the valid block or the invalid block based on the accumulation of the 
square of the variation of the image element value obtained in the block. Thus the variation amount is emphasized, 
thereby determining the variation within one block with a high precision. 

[0125] Figure 10 shows a format of coded data output from the first image data coding apparatus shown in Figure 8. 
By referring to Figure 10, the operation of the first image data coding apparatus will be explained. An original image 

35 data of one block of the present frame is written in block buffer 610 and is output to variation quantity calculating unit 
1 1 . Variation quantity calculating unit 1 1 compares original image data of the block with the image data of the block of 
the reference frame stored in image buffer 61 2 the block being provided in the same position as in the block of the orig- 
inal image data with regard to the image element provided in the same position in the corresponding two blocks, thereby 
outputting the variation amount of the image element value to block variation determining unit 61 6. 

40 [01 26] Block change determining unit 61 6 with the structures shown in any one of Figures 8 determines which block 
is the valid block according to the above described method and a signal representing the determination result (namely, 
"1" in the case of defective block and "0" in the case of invalid block) is transmitted to switch 618 and block information 
holding unit 620. 

[01 27] Block information holding unit 620, based on the above determination result signal, holds the block information 
45 which is set at "1 " in the case of a valid block and at "0" in the case of an invalid block with regard to all the blocks of 
one frame. Switch 61 8 transmits the image data of the valid block held in the block buffer 61 0 to DCT transform unit 622 
and to image buffer 61 2, thereby updating the reference image. 

[0128] The image data of the block at the same position as the valid block in the reference frame held in the image 
buffer 612 is updated to the image data of the valid block when the image data of the valid block is input. 

so [0129] Two<fimensional DCT transform unit 622 applies the secondary discrete cosine transform to the image data 
of the valid block and outputs the two-dimensional DCT coefficient obtained by such transform to quantization unit 624. 
[01 30] The two-dimensional DCT coefficient is subject to a renewal quantization in quantization unit 624 and thereaf- 
ter is subject to the variable length coding unit 626. The image data of the valid block obtained by the variable length 
coding is held in coded data holding unit 628. 

55 [0131] The above operation is applied to the image data of all the blocks of the present frame and accordingly the 
image data of the frame is completed. 

[01 32] When the coding process for all the blocks (calculated by 90 x 72 = 6480 blocks per one frame where one block 
comprises 8x8 image elements and one frame comprises 720 x 576 image elements in the case of PAL system) per 
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one frame is completed, multiplexer (MPX) 630 outputs the block information comprising 6480 bits held in the block 
information holding unit in the case of the PAL system as shown in Figure 10 and thereafter outputs the coding data of 
the valid block held in coded data holding unit 628. 

[01 33] As explained above, in the case of receipt of the image data of the new frame, the first image data coding appa- 
5 ratus rewrites only the image data in the block in the reference frame held in the image buffer 612 in the same position 
as in the block in the present or new input frame which is determined as the valid block. 

[0134] As descrtoed above the first image data coding apparatus determines the valid block which valid from the 
image of the cor responding block of the preceding frame and encodes only the image data of the valid block, thereby 
greatly decreasing the coding amount. Upon performance of the coding operation, block information designating 
10 whether the block is the valid block or the invalid block with regard to all the blocks of one frame, as well as coded data 
of the valid block, is outputted and thus the decoding side can recognize the block position of the valid block based on 
the block information, thereby enabling the image of the frame to be restored correctly. 

[0135] Figure 1 1 shows a circuit structure of the first image data restoring unit for restoring the coded data produced 
by the first image data coding apparatus into the image data. 
is [01 36] In Figure 1 1 . the multiplexer (DMPX) 640 separates input data into the block information and the coded data 
of the valid data and input them to block information holding unit 642 and coded data holding unit 644. 
[0137] Block information holding unit 642 holds the information for one frame. The coded data holding unit 644 is the 
coded data of the valid block of one frame. 

[01 38] Variable length restoring unit 646 restores the variable length coded data to the quantization coefficient of the 
20 fixed length by referring to the Hoffman table obtained statistically and stored in the Hoffman decoding table holding unit 
646a. 

[01 39] Dequantization unit 648 applies the linear dequantization to the quantization coefficient by using the threshold 
value stored in the dequantization threshold value holding unit 648a and transforms the quantization coefficient into 
two-dimensional DCT coefficients of the space frequency distribution. The inverse two-dimensional DCT transform unit 
25 650 applies the inverse two dimensional discrete cosign transform to the two-dimensional DCT coefficient and restores 
the image data of respective blocks. 

[0140] Restoring image holding unit 652 holds one block of the image data of the restored block. 
[0141] Block information detecting unit 654 detects the number of the consecutive invalid block from the block infor- 
mation input from the block information holding unit 642. 
30 [0142] Address calculating unit 656 skips the addresses of the invalid block in accordance with the continuation of the 
invalid blocks input from the block information detecting unit 654 and outputs only the block address of the valid block 
to the frame memory 658. 

[0143] Frame memory 658 stores the image data of the valid block input from the restoring image holding unit 652 
into the position of the block which is designated by the address signal input from the address calculating unit 656 and 
35 holds the restoration image data of one frame. 

[0144] Figure 12 shows a circuit block diagram of an internal arrangement of the above-described address calculating 
unit 656. 

[0145] In this circuit of Figure 12, a clock generating unit 6560 is operated under control of an update controlling unit 
6562 to generate a clock with a longer generating period than the write cycle of the image data on the valid block to be 
40 supplied to the frame memory 658. 

[0146] A latch circuit 6562 latches a serial number of invalid blocks inputted from the block information calculating unit 
654. 

[0147] Upon receipt of the invalid block signal supplied from the block information calculating unit 654. the update con- 
trolling unit 6564 causes the clocking operation of the clock generating unit to be commenced. Then, the clock derived 

45 from the clock generating unit 6560 is supplied to a counter 6566 and an OR gate circuit 6568. 

[0148] The counter 6566 increments the count value by 1 every time the dock is entered, and then outputs the result- 
ant count value to a comparing circuit 6570. The comparing circuit 6570 compares this count value with the serial 
number of invalid blocks latched in the latch circuit 6562, and outputs an incident signal to the update controlling unit 
6564 when both of these values become equal to each other. 

so [0149] When the incident signal is inputted, the update controlling unit 6564 interrupts the clocking operation of the 
clock generating unit 6560. 

[0150] The OR gate circuit 6568 outputs the clock inputted from the clock generating circuit 6560 to an X-address 
counter 6572. 

[0151 ] This X-address counter 6572 is such a counter for counting a component value (X coordinate) of an image at 
55 a block address along the horizontal scanning direction (namely, X direction), and for outputting a count value to an 
AND gate circuit 6576. Then, when the X-address counter 6572 counts up the component value at the final address 
along the horizontal scanning direction, this counter outputs a carry signal to a Y-address counter 6574. 
[0152] This Y-address counter 6574 corresponds to a counter for counting a component value (Y coordinate) of an 
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image along the vertical direction (Y direction). This Y-address counter 6574 increments the count value by 1 every time 
the carry signal is supplied from the X-address counter 6572, and outputs the resultant count value to the AND gate 
circuit 6576 as a value of the Y coordinate. 

[0153] An address of each block on the frame memory 658 may be designated by a block address (X, Y) which is 
defined based on both of the count value X of the X-address counter 6572 and the count value Y of the Y-address coun- 
ter 6574. 

[0154] When the coincident signal ©sued from the comparing unit 6570 is inputted, and thereafter the value block 
signal derived from the block information detecting circuit 654 is inputted, the update control unit 6564 outputs to the 
frame memory 658 as a write address of decoded block image data, both of the count value X of the X-address counter 
6572 and the count value Y of the Y-address counter 6574. which are derived from the AND gate circuit 6576. 
[0155] Upon completion of the writing of this decoded block image data, a block update signal is produced from a 
block image element writing control unit (not shown in Figure 1 2), so that the count value of this X-address counter 6572 
is incremented by 1 via the OR gate circuit 6568 in response to this block update signal. 

[01 56] As described above, based upon the block information received from the first image data encoding apparatus, 
in case of the invalid block, only the block address is updated at the high-speed clock generated from the clock gener- 
ating unit 6560. whereas in case of the valid block, the block address data about this valid block is outputted to the frame 
memory 658, and also the decoded image data about this valid block is written into the frame memory 658. Then, in 
case that the decoded image data of this valid block is written, when this writing operation is accomplished, the block 
address is updated in response to the block update signal inputted from the block image element writing control unit. 
[0157] In this way, in case of the invalid block, since only the updating of block address is performed, a high-speed 
decoding operation of the frame image data can be realized. 

[0158] Referring now to the arrangement of the first image decoding apparatus shown in Figures 1 1 and 12, an image 
decoding operation thereof will be explained. 

[0159] Input data having such a format as shown in Figure 10. which has been transmitted from the first image data 
coding apparatus, is separated into coded data and block information by the multiplexer 30. The coded data is held in 
the coded data holding unit 32 and the block information is held in the block information holding unit 31. 
[01 60] The variable length coded data held in the coded data holding unit 32 is decoded into a fixed length quantizing 
coefficient by the variable length decoding unit 33 with employment of the Huffman decoding list 646a. The structure of 
this Huffman decoding list 646a is inverse to that of the precedingly explained Huffman coding list 626a which is utilized 
when the image data is coded by the first image data coding apparatus. This quantizing coefficient is processed by the 
linear dequantization with employment of the dequantizing threshold value 648a by the dequantizing unit 648. thereby 
to be decoded into the two-dimensional DCT coefficient. 

[0161] The inverse two-dimensional DCT transforming unit 650 performs the inverse two-dimensional DCT conver- 
sion with using the two-dimensional DCT coefficient so that the image data about the valid block is decoded. 
[0162] Then, the decoded image data of this valid data is once stored in the decoded image holding unit 652. 
[0163] On the other hand, the block information stored in the block information holding unit 642 is processed by the 
block information detecting unit 654. In other words, the block information detecting unit 654 discriminates an appearing 
sequence of a valid block and an invalid block based on the block information. Then, when the valid block appears, the 
block information detecting unit 654 outputs the valid block signal to the address calculating unit 656. To the contrary, 
when the invalid block appears, the block information detecting unit 654 counts the number of invalid blocks which 
appear consecutively, and outputs the serial number of invalid blocks counted to the address calculating unit 656. At 
this time, the invalid block signal is also outputted to the address calculating unit 656. 

[0164] Thus, the block address of the valid block is correctly calculated based on the block information, and then the 
decoded image data of this valid block is written into the relevant position of the frame memory 658. As a consequence, 
with respect to the image data stored in the frame memory 658. only the image data about the valid blocks are updated 
in the respective flames. 

[0165] As precedingly stated, the address calculating unit 656 outputs the write address of the decode image data 
about the valid block, which has been stored in the decoded image holding unit 652. into the frame memory 658 in 
accordance with the information and the signal inputted from the block information detecting unit 654. As a result, the 
decoded image data of this valid block is written into the relevant block position of the frame memory 658 by the block 
image element writing control unit 

[01 66] Figure 1 3 is a schematic circuit block diagram for showing an overall arrangement of a second image data cod- 
ing apparatus according to another currently preferred embodiment of the present invention. 
[0167] It should be noted that the same reference numerals used in the first image data coding apparatus will be 
employed as those for denoting the same circuit blocks shown in Figure 13. 

[0168] In the second image data coding apparatus of Figure 13, an invalid block number counting unit 670 counts the 
quantity of consecutive invalid blocks by receiving the judgment result as to whether or not the valid block is present, 
from the block change determining unit 616. When the judgment result for the valid block is inputted, the above- 
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described count value is outputted to an invalid block information generating unit 672, and the switch 618 is controlled 
so as to enter the image data of the valid block temporarily stored in the block buffer 610 into the two-dimensional DOT 
transforming unit 622 and the image buffer 61 2. 

[0169] The invalid block information generating unit 672 codes the serial number of the invalid blocks supplied from 
5 the invalid block number calculating unit 670 to obtain the coded data which will then be supplied to a multiplexer (MPX) 

630: 

[01 70] Next, an operation of the second image data coding apparatus with the above-described arrangement will now 
be explained. 

[0171 ] Original image data of one frame is subdivided into a plurality of blocks and the image data are inputted in unit 

io of block. Then, the original image data of the respective blocks are written into the block buffer 610, and also are out- 
putted to the change amount calculating unit 614. The change amount calculating unit 614 compares image elements 
of the original image data of the block to be inputted with the corresponding image elements of the image data of the 
block located at the same position of the block for the reference frame stored in the image buffer 61 2 to obtain a change 
amount of a predetermined image element value from this image element comparison, and outputs this change amount 

is to the block change determining unit 61 6. 

[0172] The block change determining unit 616 is arranged by. for instance, the previously explained circuit arrange- 
ment as shown in Figures 9A, 9B. and 9C. This block change determining unit 616 judges whether or not an inputted 
block corresponds to a valid block. Then, the block change determining unit 616 supplies the judgment result to the 
switch 618 and the invalid block number counting unit 670. 

20 [0173] An invalid block number counting unit 670 is constructed of. for example, a counter which is reset to 0 when 
such a judgment result indicative of a valid block is inputted. On the other hand, when another judgment result repre- 
sentative of an invalid is inputted to this counter, the count value thereof is incremented by 1 . Then, every time the judg- 
ment result indicative of the valid block is inputted, this counter outputs the resultant count value, namely the serial 
number of valid blocks to the valid block information generating unit 672. 

25 [01 74] An invalid block information generating unit 672 codes the serial number of the inputted valid blocks to produce 
coded number data which will then be supplied to a multiplexer 630. 

[0175] Upon input of the signal representative of the valid blocks, a switch 618 causes the original image data of the 
block stored in the block buffer 610 to be furnished to the two-dimensional DGT transforming unit 622 and the image 
buffer 612. 

30 [0176] As a consequence, an image buffer 612 updates the image data of the block located at the same position as 
that of the above-described block by newly entered original image data. 

[0177] The image data of the valid block entered into the two-dimensional DCT transforming unit 622 is processed in 
a two-dimensional DCT transforming unit 622, a quantizing unit 624, and a variable length coding unit 626 by way of the 
DCT conversion, linear quantization, and variable length coding respectively in a similar manner to those of the above- 
as explained first image data coding apparatus, so that this image data is converted into coded data having a variable 
length, which will then be inputted to the multiplexer 630. 

[0178] Figure 14 shows the multiplexer 630 first outputs the coded data on the valid data stored in the coded data 
holding unit 19. and subsequently outputs a block end code (EOB). Furthermore, this multiplexer 630 outputs the coded 
data about the invalid block number supplied from the invalid block information generating unit 672. 
40 [0179] As described above, also in the second image data coding apparatus, since the valid block whose image has 
been valid with regard to the preceding frame is derived based upon the image data of the reference frame, and then 
only the image data of this derived valid block is coded, the entire coding amount can be considerably reduced. Also, 
since both of the coded data about the valid block and the serial number of the invalid blocks are coded and then out- 
putted, the block position of the valid block can be correctly recognized at the image decoding side and therefore the 
45 image can be correctly decoded. 

[0180] Furthermore, as the serial number of the invalid blocks existing among the valid blocks is coded and the coded 
serial number is outputted among the coded data of the valid blocks, only the quantity of consecutive invalid blocks may 
be outputted after the valid block as the block information. As a result, a total amount of the block information can be 
reduced in accordance with the total number of the valid blocks. Accordingly, the data transmission amount of the see- 
so ond image data coding apparatus becomes smaller than that of the first image data coding apparatus. 

[0181] Figure 15 is a schematic circuit block diagram for showing an overall arrangement of a second image data 
decoding apparatus according to the present invention, ft should be noted that like reference numerals employed for 
denoting the blocks of Figure 1 1 represent the same or similar blocks in Figure 15. 

[0182] This second image data decoding apparatus decodes the coded data produced from the first image data cod- 
55 ing apparatus, into image data. 

[0183] A code determining unit 680 discriminates coded data of valid data and coded data of an invalid block number 
from input data having a format as represented in Figure 14, thereby controlling in Figure 14. thereby controlling a 
switching operation of a demultiplexer (DMPX) 640. An invalid block information detecting unit 682 detects a serial 
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number of invalid blocks from the coded data about the invalid block number inputted from the demultiplexer 640 and 
outputs the detected serial number to an address calculating unit 656. 

[0184] A description will now be made of an operation of the second image data decoding apparatus with such a cir- 
cuit arrangement as indicated in Figure 15. 

5 [0185] Under control of the code determining unit 680. the input data having the data format indicated in Figure 14, 
which has been transmitted from the second image data coding apparatus, is separated into the coded data about the 
valid block and the coded data about the invalid block number by the demultiplexer 640. The coded data about the valid 
block is inputted into the variable length decoding unit 646. In this variable length decoding unit 646, this coded data is 
decoded into a quantizing coefficient having a fixed length with employment of a Huffman decoding list 646a having an 

w opposite structure to that of the coding table employed at the coding side. A dequantizing unit 648 processes the 
entered quantizing coefficient by way of linear dequantization with employment of an dequantizing threshold value 648a 
to obtain a two-dimensional DCT coefficient valid which will then be furnished to an inverse two-dimensional DCT trans- 
forming, unit 650. The inverse two-dimensional DCT transforming unit 650 performs the inverse two-dimensional DCT 
conversion with using the entered two-dimensional DCT coefficient, thereby decoding data. 

15 [0186] These process operations are carried out in unit of 1 block, and the decoded image data about a single block 
is once stored in the decoded image holding unit 652. 

[01 87] On the other hand, the decoded data about the invalid block number separated from the input data and derived 
from the demultiplexer 640, is inputted to the invalid block information detecting unit 682. 

[0188] The invalid block number detecting unit 682 detects the serial number of invalid blocks from the coded data 
20 and supplies the detected serial number to the address calculating unit 656. The address calculating unit 656 calculates 
the block address of the frame memory 658 into which the decoded image data stored in the decoded image holding 
unit 652 should be written in accordance with the information about the serial number of the inputted invalid blocks, and 
then furnishes the calculated address to the frame memory 658. In the frame memory 658. the decoded image data of 
the block stored in the decoded image holding unit 652 is written in the relevant block address thereof. 
25 [0189] As previously described in detail, the second image data decoding apparatus calculates the block address of 
the valid block to which the coded data is sent, based on the coded data about the invalid block, and writes the decoded 
image data of this valid block into the corresponding block position within the frame memory 658. whereby the image 
data located at the same position as that of this valid block is updated. 

[0190] Figure 16 is a schematic circuit block diagram for showing an entire arrangement of a third image data coding 
30 apparatus according to the present invention. 

[0191] In Figure 16. it should be understood that the same reference numerals used to the blocks shown in Figure 8 
are employed as those for indicating the same or similar blocks. 

[01 92] A binary coding unit 690 binary-codes block information stored in a block information holding unit 620 by way 
of. for instance, a run length coding and the like to obtain binary-coded data, and outputs this binary-coded data to a 
35 multiplexer (MPX) 630. 

[0193] Then, an operation of the third image data coding apparatus will now be descrbed. 

[0194] In the third image coding apparatus of Figure 16, original data of 1 block in the present frame is written into the 
block buffer 610 and also supplied to the change-amount calculating unit 614. The change-amount calculating unit 614 
compares the image elements of this block image data with the image elements of the corresponding image data 
40 present at the same position as that of the reference frame block stored in the image buffer 624. thereby obtaining a 
change amount in the image element values. Then, the change amount in the image element values is outputted from 
the change-amount calculating unit 614 to the block change determining unit 616. 

[0195] The block change determining unit 616 with such a circuit arrangement as shown in Figs. 8A. 8B. or 8C, will 
judge whether or not the relevant block is equal to the valid block based on the change amount in the image element 

45 value, and then outputs this judgment result to the switch 618 and the block information holding unit 620. 

[01 96] The block information holding unit 620 sets "1 " when the relevant block corresponds to the valid block, and sets 
"0" when the relevant block corresponds to the invalid block, and furthermore holds this block information with respect 
to all blocks in a single frame. On the other hand, the switch 61 8 supplies the image data about the relevant block stored 
in the block buffer 610 to the two-dimensional DCT transforming unit 622 and the image buffer 624 when such a judg- 

so ment result indicative of the valid block is inputted thereto. As a consequence, the image buffer 624 rewrites the image 
data about the block located at the same position as that of this valid block by the image data about this valid block, so 
that the image data of the reference frame is updated. 

[0197] On the other hand, the image data of this valid block inputted into the two-dimensional DCT transforming unit 
622 is sequentially processed by way of the two-dimensional DCT conversion, linear quantization and variable coding 
55 in the two-dimensional DCT transforming unit 622. quantizing unit 624, and variable length coding unit 626 in order to 
be coded. Thus, the coded data of the image data about this valid data, which has been obtained by this coding oper- 
ation, is held in the coded data holding unit 628. 

[0198] When a series of the above-explained process operation has been completed with respect to all blocks in a 
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single frame, the binary coding unit 690 binary-codes the block information about ail blocks stored in the block informa- 
tion holding unit 620 to obtain binary-coded data. Thus, this binary coding unit 690 outputs the binary-coded data about 
the block information to the multiplexer (MPX) 630. 

[0199] Similar to the previous multiplexer shown in Figure 5 which outputs the coded data, this multiplexer 630 first 
5 outputs the coded data on the block information inputted thereto from the binary coding unit 690, and thereafter outputs 
to coded data of the valid block held in the coded data holding unit 628. 

[0200] As previously explained, since such a valid block whose image has changed with respect to the preceding 
frame, is extracted based on the image data about the reference frame, which has been stored in the image buffer 624, 
and thus only the image data of this valid block is decoded, a total coding amount can be greater reduced. Also, since 
10 together with the coded data about the valid block, the block information indicating whether all of the blocks in the frame 
are the valid blocks or the invalid blocks, is coded and the coded data/information are outputted, the block positions of 
the valid blocks can be correctly recognized at the decoding side. As a result, the original image can be correctly 
decoded. 

[0201] As the block information is similarly decoded in this third image data coding apparatus, a total coding amount 
15 can be reduced. 

[0202] Figure 1 7 shows a circuit block diagram of an overall arrangement of a third image data decoding apparatus 
according to another currently preferred embodiment of the present invention. The third image data decoding apparatus 
decodes image data from coded data produced from the above-described third image data coding apparatus. It should 
be noted that like reference numerals employed in the first image data decoding apparatus shown in Figure 1 1 indicate 
20 the same or similar blocks in this third image data decoding apparatus. 

[0203] A binary decoding unit 696 decodes the coded data about the block information, which has been stored via 
the demultiplexer (DMPX) 640 into the block information holding unit 642 and has been coded by the third image data 
coding apparatus, to obtain original information. 

[0204] A description will now be made of an operation of the image data decoding apparatus shown in Figure 1 7. 
25 [0205] The coded data produced from the third image data coding apparatus shown in Figure 1 6, is separated by the 
demultiplexer 640 into the coded data of the valid data and the coded data of the block information. Then, the coded 
data is stored in the coded data holding unit 642, whereas the coded data of the block information is stored in the block 
information holding unit 654. 

[0206] The variable length coded data of the valid data stored in the coded data holding unit 644 is decoded by the 
30 variable decoding unit 646 into a quantizing coefficient having a fixed length with employment of the Huffman decoding 
table 646a whose structure is inverse with respect to that of the Huffman coding table 626a employed in the coding 
operation. The quantizing coefficient is processed by way of the linear dequantization in the dequantizing unit 648 with 
using the dequantizing threshold value 648a, thereby being converted into the two-dimensional DCT coefficient. The 
inverse two-dimensional DCT transforming unit 650 performs the inverse two-dimensional DCT conversion with 
35 employment of this two-dimensional DCT coefficient, so that the image data of the valid block is decoded. 

[0207] These process operations are carried out in unit of a single block, and then the decoded image data about the 
decoded 1 valid block are one stored into the decoded image holding unit 652. 

[0208] On the other hand, the coded data of the block information is decoded by the binary decoding unit 696 into the 
original block information which will then be outputted to the block information detecting unit 656. Based on this block 

40 information, the block information detecting unit 654 detects the block position of the valid block and counts the serial 
number of the invalid blocks among the valid blocks, and also outputs the resultant information to the address calculat- 
ing unit 656. Based on the entered information, the address calculating unit 656 calculates the write address of the valid 
block stored in the decoded image holding unit 652, within the frame memory 658. and then supplies the calculated 
address data to the frame memory 658. The frame memory 658 writes the decoded image data about the decoded 

45 image data about the valid block held in the decoded image holding unit 652, into the block address designated by this 
address signal in accordance with the address signal. 

[0209] As described above, the block address for the valid block is calculated based on the coded data of the block 
information, the decoded image data of this valid data is written into the corresponding position of the reference frame, 
and then the image data about the reference frame may be updated. 
so [0210] In this case, since the block information has been coded and the coded block information is transmitted, a 
transmission amount of the coded data may be reduced. 

[021 1] It should be noted that although the count value of the counter 6566 is incremented by the number equal to 
the serial number of the invalid blocks in the address calculating unit 656 of the above-described image data decoding 
apparatus when the serial number of the valid block is entered, alternatively, the count value of the X-address counter 
55 6572 may be summed with the serial number of the invalid blocks, thereby obtaining the block address. 

[021 2] Furthermore, although both of the image data coding apparatus and the image data decoding apparatus are 
arranged by the hardware in the above-described preferred embodiments, the functions of the blocks employed in these 
apparatus may be executed by a microprocessor and a digital signal processor in accordance with a software process. 



17 



3NSDOCID: <EP 0899959A2J_> 



EP 0 899 959 A2 



[021 3] In accordance with this preferred embodiment, as previously described in detail, a comparison is made in unit 
of a single block between the image data of the present frame and the image data of the reference frame utilized as the 
image data of the preceding frame, whereby a selection is performed only tor the image data of the valid block whose 
image has changed with respect to the image of the preceding frame. Then, since only the image data about this valid 

5 block is coded and outputted. the data compression rate of such consecutive image data that own a small image data 
that own a small change among these consecutive images. As a consequence, averaged compression rates about 
moving images of a television telephone system where a television camera is fixedly employed, and moving images of 
a moving whose variations in the successive frames become small, may be increased. Also since the block information 
indicative of the positional information about the invalid block is outputted together wfth the coded data of the valid block. 

io the correct position of the valid block can be recognized based on this block information, so that the image can be cor- 
rectly decoded. 

[0214] Figure 18 is a flow chart for explaining a second image data coding method according to a presently preferred 
errtbodimerrt of.the present invention. 

[0215] In accordance with the second image data coding method, image data about a single frame is subdivided into 
15 a plurality of sub-blocks having m x n image elements (symbols "nrf and "n" denote natural numbers), and the image 
data are coded in unit of block Furthermore, two threshold values different from each other are employed as a thresh- 
old value used to judge the above-described valid block. 

[0216] In the image data coding method shown in Figure 18, with regard to the first block (sub-block) in the present 
frame, a comparison is made between the image elements of this first block and the image elements of the correspond- 

20 ing block located at the same position as the reference frame (preceding frame), thereby calculating a change amount 
in predetermined image element values. Then, this change amount is compared with the presently selected threshold 
value in order to judge whether or not the first block of the present frame corresponds to the valid block (step S2 1 ). 
[0217] In this case, when the change amount in the image element values becomes greater than the presently 
selected threshold value, it is judged that the first block corresponds to the valid block At a step S22, when the first 

25 block is the valid block change information (e.g. "1 ") indicative of such a valid block is outputted. 

[0218] Subsequently, another threshold value having a small value is selected as the threshold value for determining 
the valid block (step S23). Then, after this first block has been processed by way of the two-dimensional DCT conver- 
sion and the quantization, the processed first block is coded, and the content of the block for the above-described ref- 
erence frame located at the same position as that of the first block is updated by the content of the first block (step S24). 

30 [021 9] To the contrary, when another judgment is made that the first block corresponds to the invalid block at the pre- 
vious step S21 , change information (e.g., "0T representative of such an invalid block is outputted (step S25). 
[0220] Next, the threshold value having a large value is selected as the threshold value used to judge the valid block 
(step S26). 

[0221 ] Thereafter, the above-explained process operations as defined at the steps S21 to S26 will be repeatedly per- 
35 formed with regard to all of the blocks subsequent to the second block of the present frame, thereby producing the 
change information for indicating whether the relevant block among all blocks corresponds to the valid block or the 
invalid block Also, the image data of the valid block are coded and the coded image data are outputted. Furthermore, 
the block located at the same position as that of such a block which has been judged as the valid block in the present 
frame within the block of the reference frame, is rewritten by these valid blocks to update the reference frame. 
40 [0222] Then, when a judgment result "YES" at a step S27 is made of the above-explained process operations defined 
from the step S21 to the step S26 with respect to all blocks within the present frame, the coding process of the image 
data tor the present frame is completed. 

[0223] As previously described in detail, according to the second image data coding method, with respect to the block 
located at the same position of the preceding frame within the respective blocks of the present frame, only the block 

45 whose image has changed is selected as the valid block Since only the image data of this valid block is coded, a total 
amount of such coded data as images having small movement, for instance, a consecutive image of background having 
a small image variation, can be considerably reduced with respect to a total amount of entire coded data. 
[0224] Further, since the valid block is judged based on the result of determining whether or not the block corresponds 
to the valid block by changing the determining threshold value, even when the images are gently varied among the 

so blocks, the regions over which the images start to change and stop to change can be judged as the region for the valid 
block so that it is possible to prevent such a discontinuous movement of image from which the valid blocks project. 
[0225] Figure 1 9 shows a circuit diagram of a fourth image data coding apparatus for coding consecutive image data 
which have been produced from the above-explained second image data coding method. 

[0226] In Figure 19, a block buffer 700 temporarily stores the image data in unit of single block, inputted from an input 
55 terminal 700a. 

[0227] A reference frame holding unit 702 is a memory to store image data of a reference frame. The image data of 
this reference frame will be used as image data of the preceding frame. 

[0228] A block-change determining unit 704 compares image elements of block image data of the present frame 
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which has been stored in the block buffer 700 with image elements of block image data of the reference frame which 
has been stored in the reference frame holding unit 702 and is located at the same position as that of the first-men- 
tioned block image data, thereby calculating change amounts of predetermined image element values for the respective 
blocks of the present frame with respect to the reference frame. Then, this block-change determining unit 704 further 

s compares the change amount of the image element values with a threshold value derived from a threshold value hold- 
ing unit 706. thereby determining a change in the images of the respective blocks of the present frame with respective 
to the reference frame, namely determining whether or not the input block is a valid block. This change amount of the 
image element values includes either a maximum value of an absolute value for differential image element values within 
the input block, or an accumulated value of absolute values for all of differential image element values within the input 

;o block, otherwise an accumulated value of squared values for absolute values of all of differential image element values 
within the input block. 

[0229] A determining-threshold-value holding unit 7006 holds two different sorts of threshold values (will be referred 
to "a large threshold value and a small threshold value") and selects one erf these two threshold values in accordance 
with a threshold-value changing signal supplied from the block-change determining unit 704 to furnish the selected 
75 threshold value to the block-change determining unit 704. A block information holding unit 708 holds change informa- 
tion (information indicating whether an input block corresponds to a valid block, or an invalid block) of the input block 
supplied from the block change determining unit 704. 

[0230] A variable length coding unit 71 0 codes only the image data of the valid block stored in the block buffer 700 in 
accordance with the judgment result indicating whether or not the respective blocks correspond to the valid block, which 

20 are entered from the block-change determining unit 704. The variable length coding unit 710 is constructed of. as 
shown in Figure 20, a two-dimensional DCT transforming unit 7100 for transforming the transmitted block image by way 
of a two-dimensional discrete cosine conversion into a two-dimensional DCT coefficient of a spatial frequency distrac- 
tion, a quantizing unit 7102 for quantizing this two-dimensional DCT coefficient with a visually adaptive threshold value 
to obtain a quantizing coefficient, and a variable length coding unit 7104a for variable-length-coding the quantizing coef- 

25 f icient based on a statistically obtained Huffman table. 

[0231] A multiplexer 710 selectively outputs the block information about all blocks of the present frame which have 
been stored in the block information holding unit 708, and the coded data produced from the coding unit 710. 
[0232] Operations of the image data coding apparatus with the above-described arrangement will now be explained. 
[0233] The image data of the each block for the present frame is inputted into the input terminal 700a, and then tem- 

30 porarily stored in the block buffer 700. The reference frame holding unit 702 stores therein the reference image data 
used to detect whether or not there is a change of the image of the present block with respect to the image of the pre- 
ceding frame. 

[0234] The block-change determining unit 704 compares image elements of block image data of the present frame 
which has been stored in the block buffer 700 with image elements of block image data of the reference frame which 

35 has been stored in the reference frame determining whether or not the input block is a valid block. This change amount 
of the image element values includes either a maximum value of an absolute value for differential image element values 
within the input block, or an accumulated value of absolute values for all of differential image element values within the 
input block, otherwise an accumulated value of squared values for absolute values of all of differentia) image element 
values within the input block. Then, the block-change determining unit 704 supplies the judgment result (indicating 

40 either a valid block, or an invalid block) to the block information holding unit 708 so as to be stored therein. 

[0235] The block-change determining unit 704 outputs a reference frame rewriting signal to the reference frame hold- 
ing unit 702 when the judgment result indicates the valid block. Upon receipt of the reference frame rewriting signal, the 
reference frame holding unit 702 updates the image data of the block located at the same position as that of the valid 
block held therein by the image data of this valid block which is now stored in the block buffer 700. 

45 [0236] Furthermore, the block-change determining unit 704 supplies the threshold-value changing signal in accord- 
ance with the judgment result to the determining-threshold-value holding unit 706, and changes the threshold value 
derived from the determining-threshold-value holding unit 706 from the large threshold value into the small threshold 
value when the judgment result is the valid block, and conversely changes it from the small threshold value into the 
large threshold value when the judgment result is the invalid block. Also, the block-change determining unit 704 outputs 

so the judgment result to the variable length coding unit 71 0. The variable length coding unit 71 0 reads out the image data 
of this valid block from the block buffer 700 when the input judgment result corresponds to the valid block to code this 
image data, and, to the contrary, does not execute the reading and coding operations for the image data of the invalid 
block when the judgment result corresponds to the invalid block. 

[0237] The multiplexer 712 sequentially switches the block information stored n the block information holding unit 708 
55 and the variable length coded data inputted from an ADCT coding unit 71 0 to successively output the switched data. 
[0238] As described above, in accordance with the fourth image data coding apparatus, when it is judged that the 
present block is the valid block, the determining threshold value is set to the small threshold value, and then another 
judgment is made of the change in the image of the subsequent block with respect to the reference frame based on this 
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small threshold value. To the contrary, when it is judged that the present block is the invalid block, the determining 
threshold value is set to the large threshold value, and then a check is done of the change in the image of the next block 
with respect to the reference frame based on the large threshold value. 

[0239] As previously explained, depending upon such a fact whether or not the image in the present block is varied, 
5 the threshold value is selected which is employed to judge the image variation occurring in the subsequent block, so 
that the valid block regions along the block scanning direction can be consecutively extracted. As a result, it is possible 
to suppress an unnatural scene of the blocks displayed on the screen, which is caused when the valid blocks are inter- 
ruptedly continued. 

[0240] Referring now to Figures 21 to 23, the above-described advantages of the preferred embodiment will be 

10 described more in detail. As represented in Figure 21 A, when the image of the block is gradually changed, as compared 
with that of the preceding block, in accordance with the method for determining the valid block by comparing the change 
amount of the block with a single threshold value, the following difficulties may be produced. That is, as shown in Figure 
21 B, both of Jhe.change starting portion -A" of the image and the change ending portion "C" thereof within the regions 
A. B, C would be judged as the "invalid blocks", and only the change peak portion "B" would be judged as the Valid 

is block". As a consequence, since only the region B is reproduced, or decoded during the image decoding operation, this 
region B may give such an impression that this region is projected from the adjoining regions A, C. 
[0241 ] To the contrary, in accordance with the fourth image coding apparatus of the present invention, as represented 
in Figure 21 C, when a judgment is made that the image change peak portion B is the valid block, since the determining 
threshold value for the valid block is selected to be a low threshold value, the region C can also be judged as the valid 

20 block, so that the valid block region may be continued. 

[0242] As indicated in Figure 22A, when the block B having a small image change is solely present within the valid 
block region, if only one threshold value would be employed as the determining threshold value of the valid block, judg- 
ments could be made of the valid block A, invalid block B and valid block C (see Figure 22B), so that the valid blocks 
would be interrupted, resulting in an unnatural decoded image. To the contrary, in case of the fourth image data coding 

25 apparatus, as illustrated in Figure 22C, when the block A is judge as the valid block, the small determining threshold 
valid is selected, so that the block B is also judged as the valid block resulting in a natural decoded image. Thus, the 
valid block region may be continued from the change starting region A to the change ending region C. 
[0243] Similarly, as indicated in Figure 23A, in case of images whose block change amounts are not constant, if only 
one determining threshold value is employed, then the valid blocks appears intermittently (see Figure 23B). If the fourth 

30 image data coding apparatus is employed, as represented in Figure 23C, the valid blocks are continued and therefore 
the image quality of the decoded image can be improved. 

[0244] Figure 24 is a flow chart for explaining a third image data coding method according to another preferred 
embodiment of the present invention. 

[0245] Also in this third image data coding method, the image data of each block for the present frame is compared 
35 with the image data of the block for the preceding frame, which is located at the same position of the first-mentioned 

block, whereby a judgment is made as to whether or not each block of the present frame is the valid block (step S31). 

Then, in case of the valid block, for instance, the change information of "1" is outputted (step S2) t and one threshold 

value having a small value is selected as the determining threshold value of the valid block (step S33). 

[0246] On the other hand, in case of the invalid block for example, the change information of "0" is outputted (step 
40 S34), and thereafter the other threshold value having a large threshold value is selected as the threshold value for the 

valid block (step S35). 

[0247] The featured process of this third image data coding method is processes defined after the step $36. That is, 
when it is judged that the present block corresponds to the valid block, after the process operation of the previous step 
S33 has been performed, another judgment is again made as to whether or not the preceding block is the valid block 

45 by employing the small threshold value selected at the step S33. 

[0248] Then, when the preceding block is the valid block the change information of this preceding block is set to, for 
instance, "1" (step S37). As a result, if the preceding block has been judges as the invalid block at the previous step 
S31, then the change information thereof is changed from, for example, "0" to "1". In other words, the preceding block 
is changed from the invalid block into the valid block. Then, this preceding block which has been judged as the valid 

so block is coded (step S38). 

[0249] On the other hand, subsequent to the above step S35. another judgment is made whether or not the preceding 
block corresponds to the valid block (step S39). Then, if the preceding block is the valid block then the image data of 
the preceding block is coded (step $40). 

[0250] As described above, when a judgment is made that the present block corresponds to the valid block the 
55 threshold value used for determining the valid block is reduced, and a check is done whether or not the preceding block 
corresponds to the valid block Then, as a result of this judgment, when such a judgment is made that the preceding 
block is the valid block the change information of the preceding block is set to T indicative of being the valid block, and 
the image data of this preceding block is coded. 
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[0251 ] On the other hand, when the present block corresponds to the invalid block, the threshold value for determining 
the valid block is increased. Then, if the preceding block is the valid block, then the image data of this preceding block 
is coded. 

[0252] When a series of process operations as defined from the step S31 to S40 have been accomplished as to the 
5 present frames of all blocks (step $41), a check is done as to whether or not the final block of the present frame corre- 
sponds to the valid block (step S42). If the final block corresponds to the valid block, then the image data of this final 
block is coded (step S43). 

[0253] Figure 25 is a schematic block diagram for indicating a circuit arrangement of a fifth image data coding appa- 
ratus for coding a consecutive image by way of the above-described third image data coding method. It should be 

w understood that the same reference numerals used to represent the circuit blocks in the fourth image data coding appa- 
ratus shown in Figure 19 are employed to indicate the same or similar circuit blocks in Figure 25. 
[0254] In the fifth image data coding apparatus of Figure 25. a preceding block holding unit 242 holds the image data 
of the block (namely, preceding Wock) prior to the image data of the present block which has been stored in the block 
buffer 700. Similar to the block change determining unit 704 employed in the fourth image data coding apparatus, a 

is block change determining unit 722 corresponds to such a circuit for determining whether or not each of the blocks in 
the present frame is a valid block. When this block change determining unit 72 judges that the present block stored in 
the block buffer 700 is the valid block, the determining unit 72 outputs a preceding block rechecking signal to the pre- 
ceding block holding unit 724. 

[0255] Next, a description will now be made of operations of the fifth image data coding apparatus with the above- 

20 described circuit arrangement 

[0256] The image data of the respective blocks in the present frame are entered from the input terminal 700a into the 
block buffer 700 so as to be temporarily stored therein. The reference frame holding unit 702 holds the image data of 
the reference frame which is used to detect whether or not there is a change in the image of the block in the present 
frame with respect to the image of the corresponding block in the preceding frame. The blocks in the present frame are 

25 stored in the block buffer 700. 

[0257] The block change determining unit 722 reads out the image data of the relevant block of the reference frame 
from the reference frame holding unit 702. The relevant block is located at the same position as that of the present block 
stored in the block buffer 700. Furthermore, the block change determining unit 722 compares image elements of the 
image data of the relevant block in the reference frame with image elements of the image data of the present block, 

30 which are located at the same positions, and then calculates a change amount of the block based on change amounts 
in these image elements, namely a so-called "a block change amount" (for example, a maximum value of absolute val- 
ues for the above-explained change amount, an accumulated amount of absolute values for all image elements, an 
accumulated amount of squared values of the change amounts for all image elements. Furthermore, the block change 
determining unit 722 compares this block change amount with the threshold value outputted from the determining- 

35 threshold value holding unit 706, thereby determining whether or not the present block corresponds to the valid block 
(namely, a block whose change amount is greater than the threshold value). 

[0258] Then, when the present block corresponds to the valid block, the block change determining unit 722 outputs a 
reference frame rewriting signal to the reference frame holding unit 702. Upon receipt of this reference frame rewriting 
signal, the reference frame holding unit 702 updates the image data of the block in the reference frame held therein, 
40 located at the same position as that of the present block, by the image data of the present block stored in the block 
buffer. 

[0259] In addition to the above operation, the block change determining unit 722 outputs a threshold value changing 
signal corresponding to the judgment result to the determining threshold value holding unit 706, and performs such a 
control that when the judgment result is the valid block, the threshold value derived from the determining threshold 

45 value holding unit 706 becomes a small threshold value, whereas when the judgment result is the invalid block, the 
threshold value derived from the determining value holding unit 706 becomes a large threshold value. 
[0260] Moreover, the block change determining unit 722 reads out the image data of the preceding block from the 
preceding block holding unit when the judgment result is the valid block, and compares the image data of this preceding 
block with the image data of the block in the reference frame in the above-described manner, the block of the reference 

50 frame being located at the same position as the block of the preceding block held in the reference frame holding unit 
702, whereby a recheck is made as to whether or not the preceding block corresponds to the valid block. 
[0261 ] Then, when the block change determining unit 722 judges that the preceding block is the valid block, the deter- 
mining unit 722 sets the judgment result (change information) of this preceding block to the valid block (for instance, 
T), and outputs the set change information to the block information holding unit 708 and the coding unit 710. On the 

55 other hand, when the block change determining unit 722 judges that the preceding block is the invalid block, this deter- 
mining unit 722 outputs the judgment result (change information) of the preceding block held therein to the block infor- 
mation holding unit 708 and the coding unit 710. 

[0262] When the judgment result of the valid block is derived from the block change determining unit 722, the variable 
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length coding unit 710 codes the image data of the preceding block held in the preceding block holding unit 724 and 
then outputs the coded image data to the multiplexer (MPX) 712. Conversely, when the judgment result of the invalid 
block is derived from the block change determining unit 72. the variable length coding unit 72 does not execute the 
above-described coding operation. 
5 [0263] The multiplexer 71 2 sequentially switches the change information about the respective blocks held in the block 
information holding unit 708 and the variable code data about the respective blocks inputted from the variable length 
coding unit 15, and successively outputs the above-described two sorts of information. 

[0264] As described above, in the fifth image data coding apparatus, when a judgment is made that the present block 
is the valid block, the determining threshold value of the valid block is set to the small threshold value, and the image 

w change of the preceding block is rechecked based on this small threshold value. Then, when another judgment is made 
that the preceding block is the valid block during this rechecking operation, the change information of the preceding 
block is set to the valid block. On the other hand, when a judgment is done that the present block is the invalid block, 
the deter mining -threshold value of the above • explained valid block is set to the large threshold value in order to judge 
the image change of the next block 

15 [0265] As described above, a selection is made of the determining threshold values for the valid block based on such 
a fact whether or not the present block is the valid block, namely whether or not there is an image change in the present 
block. When it is judged that the present block is the valid block, the preceding block is rechecked based on the small 
threshold value whether or not this preceding block corresponds to the valid block. As a result, even when the image is 
gradually changed within a certain region, the valid block can be properly judged. 

20 [0266] Such an effect will now be explained with reference to Figures 21 to 23. 

[0267] First, as represented in Figure 21 A, if the image of the block like a portion constructed of the regions A, R, C 
is gradually varied, when the judgment of the valid block would be carried out based on a single threshold value, both 
of the change starting region A and the change ending region B would be judged as the invalid blocks, and only the 
image change peak region B would be judged as the valid block (see Figure 21 B). As a result , it may be felt that the 

25 region B corresponding to the valid block is projected from the adjacent regions A and C. 

[0268] To the contrary, in case of the fifth image data coding apparatus, as illustrated in Figure 21 E, when a judgment 
is made that the image change peak region B is the valid block, the determining threshold value of the valid block is 
changed into the small threshold value. Thereafter, since the region A is again checked as to whether or not this region 
A is the valid block based on this small threshold value, it can be judged that this region A corresponds to the valid block. 

30 As a consequence, as shown in Figure 21 E, the consecutive region from the image change starting region A to the 
image change ending region B may be judged as the valid block region. Therefore, since the images of the regions A, 
B, C are varied together during the image decoding operation, a natural image reproduction could be realized. 
[0269] Further, as represented in Figure 22A, when a region B having a small image variation is solely present within 
a consecutive region whose image has been changed with respect to the image of the preceding frame, in case that 

35 only one determining threshold value of the valid block is employed, the following judgment result is obtained. The 
region A is the valid block, the region B is the invalid block, and the region C is the valid block, so that the regions of the 
valid block are interrupted, which gives such an impression that an unnatural decoded image is observed during the 
image is observed during the image decoding/representing operations. However, in accordance with the fifth image 
data coding apparatus, as illustrated in Figure 22C, since the region B is also judged as the valid block, a consecutive 

40 region from the image change starting region to the image change ending region can be judged as the valid block. As 
a consequence, since any of the regions A, B and C are varied during the decoding/displaying operations, a natural 
decoded image can be obtained. 

[0270] Similarly, as illustrated in Figure 23A, in such a consecutive region whose block change amount is not con- 
stant, when only one determining threshold value for the valid block is utilized, the regions judged as the valid block are 
45 interrupted (see Figure 23A). To the contrary, in accordance with the fifth image data coding apparatus, as shown in Fig- 
ure 23D, since a judgment is made that a consecutive region from the image change starting region to the image 
change ending region is the valid block, the image quality of the decoded image thereof can be improved. 
[0271 ] Figure 26 is the flowchart indicating the 4th image data encoding method according to the embodiment of the 
present invention. 

so [0272] In this encoding method, two thresholds each having a different value are used as a valid or block determina- 
tion threshold. 

[0273] According to this encoding method, a threshold having a smaller value (a smaller threshold) is selected as a 
valid block determination threshold (S51). 

[0274] First, it is determined using the smaller threshold whether or not the present block is valid or (S52). If yes, a 
55 threshold having a larger value (a larger threshold) is selected as a valid or block determination threshold (S53). 
[0275] Then, it is determined using the larger threshold whether or not the succeeding block is valid (S54). If yes, a 
value indicating that the present block is valid ("r, for example) is outputted to change information on the present block 
(S55). Next, the image in the present block are encoded (S56). 
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[0276] If it is determined that the succeeding block is invalid in step S54, then a value indicating that the present block 
is invalid ("0". for example) is outputted as change information on the present block (S57). In this case, the image data 
in the present block are not encoded. 

[0277] The processes in steps S51 through S57 are performed on all blocks in a frame. If the change information has 
5 been outputted for the second block from the last (-Yes" in S58), then it is determined using a smaller threshold whether 
or not the last block is valid (S59). Only if it is determined that the block is valid, the image data in the last block are 
encoded (S60). 

[0278] Thus, in this encoding method, it is determined using the smaller threshold whether or not the present block is 
valid. If yes, it is determined using the larger threshold whether or not the succeeding block is valid. Only if it is deter- 

w mined that the succeeding block is valid, it is determined that the present block is valid, a value indicating that the 
present block is valid is set and outputted to the change information on the present block, and the image data in the 
present block are encoded. That is. also in this encoding method, the data in a valid block can be encoded. 
[0279] Figure 27 is the block diagram irKiicating the circuit configuration of the 6th image data encoding device for 
encoding image data in a frame in block units according to the 4th image data encoding method. 

is [0280] In Figure 27. a block which also appears in the block diagram indicating the 4th image data encoding device 
shown in Figure 19 is given the number assigned therein. 

[0281 ] A present block buffer 732 stores image data in the present block whose data are to be encoded. 

[0282] A succeeding block buffer 734 stores image data in the succeeding block applied through input terminal 700a. 

[0283] A block change determining unit 736 determines using a smaller threshold applied by the determination 

20 threshold value storing unit 706 whether or not the above described present block is valid according to the image data 
in the present block stored in the present block buffer 732 and to the image data in the reference frame stored in the 
reference frame storing unit 701. If the determination indicates that the present block is valid, then the block change 
determining unit 736 determines using a larger threshold applied by the determination threshold value storing unit 706 
whether or not the succeeding block is valid according to the image data in the succeeding block stored in the succeed- 

25 ing block buffer 734 and to the image data in the reference frame stored in the reference frame storing unit 701 If the 
determination indicates that the succeeding block is valid, then the determination result is outputted to the block infor- 
mation storing unit 708 and the encoding unit 710 as the change information on the present block. 
[0284] That is, the block change determining unit 736 reads from the reference frame storing unit 732 the image data 
in the block, located at the position corresponding to that of the present block stored in the present block buffer, in the 

30 reference frame, compares picture elements in the image data in the present block with those in the block in the refer- 
ence frame, obtains a variation in a block according to the variation of each picture element (for example, the maximum 
value in a block, an accumulative value of absolute values of the above described variations of all picture elements, an 
accumulative value of square numbers of the variation of all picture elements, etc.), compares the block variation with 
a smaller threshold applied by the threshold storing unit 706. and determines whether or not the present block is valid 

35 after determining whether or not the block variation is larger than the smaller threshold. 

[0285] Then, if the determination result indicates a valid block, then the block change determining unit 736 internally 
stores change information indicating a valid block, outputs a threshold change signal to the determination threshold 
storing unit 706, and switches thresholds outputted by the determination threshold storing unit 706 from a smaller 
threshold to a larger threshold. 

40 [0286] The block change determining unit 736 reads image data in the succeeding block from the succeeding block 
buffer 734. reads from the reference frame storing unit 701 the image data in the block, located at the position corre- 
sponding to that of the succeeding block, in the reference frame, and then calculates the block variation as described 
above. The block variation is compared with a larger threshold applied by the determination threshold storing unit 706. 
and it is determined whether or not the succeeding block is valid. 

45 [0287] Then, if the block change determining unit 736 determines that the succeeding block is valid or valid, then it 
determines that the present block is valid, and outputs the determination result of the present block (indicating a signif- 
icant block) to the block information storing unit 708 and the encoding unit 71 0. If the block change determining unit 736 
determines that the succeeding block is invalid, then it turns the determination result of the present block to "an invalid 
block", and outputs it to the block information storing unit 708 and the encoding unit 710. 

so [0288] When the block change determining unit 736 determines that the present block is a valid or valid block, then it 
outputs a reference frame rewrite signal to the reference frame storing unit 701 . On receiving the signal, the reference 
frame storing unit 701 updates the image data in the block in the reference frame to the data in the corresponding block 
in the present block. 

[0289] On receiving a determination result from the block change determining unit 736, the encoding unit 710 reads 
55 the image data in the present block from the block buffer 732, encodes the image data in the present block, and outputs 
them to the multiplexer (MPX) 712. However, if the determination result indicates an invalid Hock, the encoding unit 71 0 
encodes no image data in the present block. 

[0290] The multiplexer 712 sequentially switches and outputs change information on each block applied from the 
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block information storing unit 708 and variable-length encoded data of a valid block received from the encoding unit 
710. 

[0291 J Thus, with the 6th image data encoding device, when the present block is determined using a smaller deter- 
mination threshold that it is a valid block, it is further determined using a larger determination threshold whether or not 
5 the succeeding block is valid. If yes. it is determined that the present block is valid. If no, it is determined that the present 
block is invalid. 

[0292] The operation of the 6th image data encoding device is explained by referring to Figures 21 through 23. 
[0293] As described above, if a block image indicates a moderate change from its preceding frame, and if a valid block 
determination is made using a single threshold for areas A, B, and C. then an image change starting area A and an 
10 image change ending area C where a change in images from its preceding frame is relatively moderate are determines 
to be invalid blocks, and only an image change peak area B is determined to be a valid block as shown in Figure 21 B. 
Therefore, the only valid block B is displayed conspicuously when an image is reconstructed, resulting in an unnatural 
image. 

[0294] With the 6th image data encoding device, if area A is determined to be valid using a smaller threshold as shown 
is in Figure 21 D. then it is determined using a larger threshold whether or not area B. that is, the succeeding block, is valid. 
Therefore, an area incficating a change in images from the preceding frame can be appropriately detected, and the 
adjacent areas A and B can be determined to be valid. As a result, a natural image is obtained after an original image 
is reconstructed. 

[0295] Furthermore, as shown in Figure 22A, if adjacent areas indicates a change in images from the preceding 
20 frames, and if the image changes moderately at the central portion of the areas, then determining a valid block using a 
single threshold determines that area A is valid, area B invalid, and area C valid or valid. Then, the reconstructed image 
looks unnatural at area B. 

[0296] On the other hand, with the 6th image data encoding device, area B is determined to be valid using a smaller 
threshold, and area C is determined to be valid using a larger threshold. Therefore, area B is determined to be vafid. As 
25 a result, as shown in Figure 22D, the adjacent areas B and C can be determined to be valid, thereby reconstructing a 
more natural image. 

[0297] Next, Figure 28 is the flowchart indicating the 5th image data encoding method. 
[0298] In this encoding method, two thresholds are used to determine whether or not a block is valid. 
[0299] That is, first, a threshold having a larger value (a larger threshold) is selected as a valid block determination 
30 threshold (S71). Using the larger threshold, it is determined whether or not the present block is valid (S72). If yes, a 
value indicating that the present block is valid ("1", for example) is set and outputted as change information on the 
present block (S73). and the image data in the present block are encoded (S74). 

[0300] H it is determined that the present block is valid in step S72, then a smaller threshold is selected as a valid 
block determination threshold (S75). Then, it is determined using the smaller threshold whether or not the present block 

35 is valid (S76). If no, a value indicating that the present block is invalid f 0\ for example) is set and outputted as change 
information on the present block (S77), and the image data in the present block are not encoded. 
[0301 ] In step S76. if it is determined that the present block is a valid block, then the larger threshold is selected as a 
valid block determination threshold (S78), and it is determined whether or not the preceding block is valid (S79). 
[0302] If it is determined that the preceding block is valid in the determination, it is determined that the present block 

40 is valid, and the processes in steps S73 and S74 are performed. 

[0303] On the other hand, H it is determined that the preceding block is invalid in step S78, then it is determined using 
the larger threshold whether or not the succeeding block is valid (S80). If yes, it is determined that the present block is 
valid, and the processes in step S73 and S74 are performed. 

[0304] If it is determined that the succeeding bloc* is valid in step S80, then the present block is considered to be 
45 valid, and only the process in step S77 is performed. 

[0305] H the processes in steps S71 through S80 are performed on all blocks in one frame, and if the processes in 
steps S71 through S80 have been completed for all blocks ("Yes" in S81), then the image data in the frame are per- 
formed. 

[0306] If it is determined in step S79 that the preceding block is invalid during the determination of the last block in a 
so frame, then it is determined that the last block is invalid, and the process in step S77 is performed immediately. 

[0307] If it is determined in step S76 that the present block is valid during the determination of the leading block, then 
the process in step S80 is performed immediately after step S78. 

[0308] Figure 29 is the block diagram indicating the general configuration of the 7th image data encoding device for 
encoding a series of images by the above described 5th image data encoding method. 
55 [0309] In Figure 29, if a block also appears in the diagrams of the 5th and 6th image data encoding devices shown in 
Figures 25 and 27 respectively, then the block is given the number assigned in these figures. 
[031 0] A block change determining unit 742 receives the image data in the present block from the present block buffer 
732, the image data in the preceding block from the preceding block buffer 724. and the image data in the succeeding 
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block from the succeeding block buffer 734. The block change determining unit 742 sequentially reads from the refer- 
ence frame storing unit 701 image data in the blocks located at the positions of the above described present, preceding, 
and succeeding blocks. Then it determines using a larger and/or smaller thresholds received from the determination 
threshold value storing unit 706 and according to the procedure shown in the flowchart shown in Figure 28 whether or 

5 not the present block indicates a difference from that in the reference frame, and is valid. 

[031 1 ] Next, the operation of the 7th image data encoding device shown in Figure 29 is explained. 
[031 2] Image data in each block in a frame are applied through input terminal 700a and temporarily stored in the suc- 
ceeding block buffer 734, and then stored in the present block buffer 732. When the image data in the present block 
have been encoded, they are transferred to the present block buffer 732, and stored therein as the image data in a new 

10 present block The image data in the present block stored in the present block buffer 732 are transferred to the preced- 
ing block buffer 724 immediately after being encoded, and stored as the image data in a new preceding block. 
[0313] When determining whether or not the present block whose image data are stored in the present block buffer 
732 is valid, the block change determlriihg unit 742 reads from the reference frame storing unit 701 the image data in 
the block located at the position corresponding to that of the present block, of the reference frame, compares the image 

75 data in the block in the reference frame with the image data in the present block stored in the present block buffer 732 
by collating picture images at the corresponding positions, and obtains the difference in picture element value for each 
image picture element Then, the difference in block units (for example, the maximum absolute value of the difference 
in a block, the accumulative value of absolute values of differences for all picture elements in a block, the accumulative 
value of square numbers of differences for all picture elements in a block, etc.) is obtained. Then, the difference in a 

20 block is compared with a larger threshold provided by the determination threshold storing unit 706, and then it is deter- 
mined whether or not the present block is valid. That is, if the above described difference in a block is equal to or larger 
than the larger threshold, then it is determined that the present block is valid. 

[0314] Thus, if the block change determining unit 742 determines that the present block is valid, then H outputs the 
determination result to the block information storing unit 708 and the encoding unit 710. Then, the encoding unit 710 
25 encodes the image data in the present block stored in the present block buffer 732. and outputs the encoded data to 
the multiplexer (MPX) 712. 

[031 5] On the other hand, the block information storing unit 708 sets a value indicating that the present block is valid 
("1 for example) as block information on the present block, and stores it as present block information (change informa- 
tion). 

30 [0316] If the block change determining unit 742 determines that the present block is invalid, it outputs a threshold 
change signal to the determination threshold storing unit 706. Then, the determination threshold storing unit 706 
switches thresholds from the larger to the smaller and outputs the smaller threshold. 

[031 7] The block change determining unit 742 determines again using the smaller threshold according to the above 
. described procedure whether or not the present block is valid. 
35 [0318] H the block change determining unit 742 determines that the present block is invalid, then it outputs the deter- 
mination result to the block information storing unit 708 and the encoding unit 710. 

[0319] Then, the block information storing unit 708 sets and stores a value indicating that the present block is invalid 
("0", for example) as present block information (change information). 

[0320] If the block change determining unit 742 determines using the smaller threshold that the present lock is valid. 
40 then it outputs a threshold change signal again to the determination threshold storing unit 706, and has the determina- 
tion threshold storing unit 706 output the larger threshold again. 

[0321 ] Then, the block change determining unit 742 reads the image data in the preceding block from the preceding 
block buffer 724, reads from the reference frame storing unit 701 the image data in the block, located at the position 
corresponding to that of the present block, in the reference frame, and then determines using the larger threshold 
45 whether or not the preceding block is valid as in the determination of the present block. 

[0322] If the block change determining unit 742 determines that the preceding block is valid, it is determined that the 
present block is valid, and the unit outputs the determination result to the block information storing unit 708 and the 
encoding unit 710. Then, the encoding unit 71 0 encodes the image data in the present block stored in the present block 
buffer 732. 

so [0323] The block information storing unit 708 sets and stores a value indicating that the present block is valid as block 
information on the present block (change information). 

[0324] ff the block change determining unit 742 determines that the preceding block is invalid, then it reads the image 
data in the succeeding block from the succeeding block buffer 734, compares the image data in the succeeding block 
with the image data in the block, located at a position corresponding to that of the succeeding block, in the reference 
55 frame, and determines using the larger threshold whether or not the succeeding block is valid. 

[0325] Thus, if the block change determining unit 742 determines the succeeding block is valid, then it determines 
that the present block is valid, and outputs the determination result to the block information storing unit 708 and the 
encoding unit 710. 
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[0326] Thus, the block information storing unit 708 and the encoding unit 710 perform the above described processes. 
[0327] H the block change determining unit 742 determines that the succeeding block is invalid, then it determines 
that the present block is invalid, and outputs the determination result to the block information storing unit 708 and the 
encoding unit 710. 

5 [0328] As a result, the block information storing unit 708 sets and stores a value indicating that the present block is 
invalid as present block information (change information). The encoding unit 710 does not encode the image data in the 
present block stored in the present block buffer. 

[0329] If the block change determining unit 742 determines that the present block is valid, then it outputs a reference 
frame rewrite signal to the reference frame storing unit 701. The reference frame storing unit 701 updates the image 

w data in its block located at the position corresponding to that of the present block to the image data in the present block. 
[0330] If the update has been completed, the image data of the present block stored in the present block buffer 732 
are transferred to the preceding block buffer 724. and then the image data of the succeeding block stored in the sue- 
ceedingblock buffer 734 are transferred to the presentblockbuffer 732 Next, the image data in a new block are entered 
through input terminal 700a. and applied to and stored in the succeeding block buffer 734. 

15 [0331] The multiplexer 712 alternately switches block information of each block stored in the block information storing 
unit 708 and variable-length encoded data of a valid block applied from the encoding unit 710, and sequentially outputs 
them. Thus, with the 7th image data encoding device, it is determined using a larger threshold that the present block is 
valid if its image is considered to have been changed from that of the preceding frame (reference frame). 
[0332] If it is determined using a larger threshold that the present block is invalid, then it is determined using a smaller 

20 threshold whether or not the image in the present frame has been changed from that in the preceding frame (reference 
frame), If, according to the determination, it is determined that the present block is valid, then it is determined using a 
larger threshold whether or not the preceding or succeeding block is valid. If according to the determination, the pre- 
ceding or the succeeding block is valid, then it is finally determined that the present block is valid. 
[0333] Since the present block is thus considered to be valid, blocks can be validly set at the area where an image 

25 indicates a moderate change from that in the preceding frame, or at a series of areas where differences in images are 
not constant. 

[0334] Next, the operation of the 7th image encoding device is explained concretely by referring to Figures 21 through 

23. 

[0335] First, as shown in Figure 21 A. if it is determined whether or not a block is valid in a series of areas A, B, and 
30 C where a change in an image raises moderately from that in the preceding frame and then reduced moderately, i: is 
determined that both image change starting area A and image change ending area C refer to invalid blocks, while it is 
determined that only area B where the image change indicates its peak refers to a valid block as shown in Figure 21 B. 
Therefore, when the series of areas are reconstructed and displayed, images are changed in area B only, while the 
same images are displayed for the present and preceding frames, thereby displaying unnatural images totally. 
35 [0336] On the other hand, with the 7th image data encoding device, it is determined using a larger threshold that area 
A is invalid and then using a smaller threshold that it is a provisional valid block. Since it is determined using a larger 
threshold that the succeeding block, that is. area B, is valid block, it is determined that area A is valid finally. Likewise, 
although it is determined using a larger threshold that area C is invalid, it is determined using a smaller threshold that 
it is valid provisionally Then, since it is determined using a larger threshold that the preceding block, that is. area B, is 
40 valid, it is determined that area C is valid finally Thus, with the 7th image data encoding device, images change in areas 
A and C where images change moderately from those in the preceding frame, and it is determined that all series of 
areas A, B. and C are valid as shown in Rgure 21 E. As a result, when images are reconstructed, all data in areas A. B. 
and C are reconstructed, thereby displaying more natural images. 

[0337] As shown in Rgure 22A, if a change in an image is more moderate in the central portion than in its adjacent 
45 end portions A and B, it is determined that only the above described central area B is invalid when a valid block deter- 
mination is made using a single threshold as shown in Rgure 22B. Therefore, the original image cannot be naturally 
displayed in smooth lines because image-changed areas are intercepted by an image-unchanged area when the orig- 
inal image is reconstructed and displayed. 

[0338] On the other hand, with the 7th image data encoding device, it is determined using a larger threshold that area 
so B is invalid, but that it is valid when a smaller threshold is used. Since it is determined using a larger threshold that area 

A, that is, the preceding block of area B, is valid, it is determined that area B is finally valid. As a result as shown in 
Figure 22C, it is determined that all areas A, B, and C are valid. Therefore, images are changed in all adjacent areas A, 

B, and C when the original image is reconstructed and displayed. Thus, a naturally reconstructed image can be dis- 
played. 

55 [0339] As shown in Figure 23A, in the series of areas where the variation in image between preceding and present 
frames (variation in block) is not constant, and the image variation is interceptedly detected, when valid block determi- 
nation is made using a single threshold, it is determined that all blocks are invalid if an image changes moderately as 
shown in Figure 23B. Therefore, when the image in the serial areas is reconstructed, image-changed areas appear as 
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being intercepted by another area, thereby displaying an unnatural image. 

[0340] On the other hand, with the 7th image data encoding device, in the above described areas where images 
changes moderately, it is determined using a larger threshold that the preceding or succeeding block is valid. Therefore, 
as shown in Figure 23F, it is determined that the above described series of areas are all valid. As a result, all these 
5 areas are changed in image when the original image is reconstructed and displayed, thereby outputting a naturally 
reconstructed image. 

[0341] The above described 7th image encoding device is realized by hardware. However, the function can be real- 
ized by software such as microprocessors and digital signal processors. 

[0342] The function can also be realized by reducing the amount of encoded transmission data by encoding block 
10 information (change information) indicating whether each block in a flame is valid or invalid. 

[0343] A rate of data compression can be greatly raised for a series of images where a small change can be detected 
between adjacent frames by selectively encoding and outputting only blocks considered to have been changed in image 
from the preceding frame. Using this effect, an average rate of compression of moving data such as TV telephones 
images, moving images, etc. for which a camera is fixed can be greatly raised. 
15 [0344] When image data in a block are encoded, valid block determination is made flexibly by using two thresholds. 
Accordingly, the reconstruction of an unnatural image can be prevented by determining a series of areas from the start 
to the end of a change to be valid block areas even when a change in image is made moderately. 
[0345] Figure 30 is the block diagram indicating the configurations of the 8th and 9th image data encoding devices 
according to the present invention. Each of the devices relates to an image data encoding device for encoding a series 
20 of image data, and comprises the following units. 

[0346] A reference frame storing unit 81 1 stores image data in a reference frame. 

[0347] A present frame storing unit 812 stores image data in the present frame (the latest frame whose data are to 
be encoded). 

[0348] A determination threshold storing unit 813 stores a threshold used in determining the existence of a change 
25 in image in each block of the present frame located at the position corresponding to that in the reference frame. 

[0349] A block change determining unit 814 obtains the variation of picture element value of a block located at a posi- 
tion corresponding to that of the reference frame stored in the reference frame storing unit 81 1 , compares the variation 
with the threshold stored in the determination threshold storing unit 813, and determines the change in image in each 
of all blocks in the present frame from the image in the block located at the position corresponding to that in the refer- 
30 ence frame. 

[0350] A block information storing unit 815 stores determination results of all blocks in the present frames obtained 
by the block change determination unit 814 as block information. 

[0351] An encoding unit 816 encodes data in a valid block which is determined to be an image-changed block com- 
pared with the corresponding block in the reference frame if the present frame is not a refresh frame, and encodes data 

35 after dividing all blocks in the present frame into valid blocks and invalid blocks which are determined to be image- 
unchanged blocks compared with the reference frame if the present frame is a refresh frame according to the block 
information on each block in the present frame stored in the block information storing unit 815. 
[0352] The reference frame storing unit 81 1 updates in the reference frame the image data in the block, located at the 
position corresponding to that of the block whose data are encoded by the encoding unit 816 in the present frame, to 

40 the encoded image data in the block in the present frame. 

[0353] The 9th image data encoding device according to the present invention further comprises, in addition to the 
units 811. 812, 813. 814. 815. and 816. a refresh signal generating unit 819 for outputting a refresh signal indicating 
that the present frame is a refresh frame to at least the encoding unit and the reference frame storing unit 81 1 each time 
the number of frames data-encoded by the encoding unit 816 reaches a predetermined value. 

45 [0354] In the 8th and 9th image data encoding device, rf the present frame is a refresh frame, then the encoding unit 
816 divides the present frame into valid blocks and invalid blocks to encode data in two steps. Therefore, the encoding 
unit 816 first encodes all valid blocks, and then all invalid blocks. 

[0355] Thus, since data in refresh frames are encoded in plural times of encoding processes, image encoded data in 
refresh frames having a large amount of codes can be transmitted and reconstructed in plural steps. 
so [0356] Therefore, reconstructing equipment can start its reconstructing process at time intervals at which framed data 
are normally reconstructed, and reduce the capacity of a code buffer at both encoding and reconstructing equipment. 
[0357] When data in a refresh frame are encoded, those in valid blocks are encoded first because they have a larger 
influence on the quality of a reconstructed image. After the data in all valid blocks have been encoded, data in invalid 
blocks are encoded. 

55 [0358] Thus, in reconstructing equipment, data in a refresh frame can be reconstructed more naturally than in a con- 
ventional method and the capacity of a buffer can be reduced in both encoding and reconstructing equipment although 
the refresh frame has a large amount of codes. 

[0359] Figure 31 is the bloc* diagram showing the configuration of the 10th image data encoding device. The device 
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refers to an image data encoding device for encoding a series of image data, and comprises the following units. 
[0360] A reference frame storing unit 821 stores image data in a reference frame. 

[0361] A present frame storing unit 822 stores image data in the present frame (the latest frame whose data are to 
be encoded). 

[0362] A determination threshold storing unit 823 stores a threshold used in determining the existence of a change 
in image in each block of the present frame located at the position corresponding to that in the reference frame. 
[0363] A block change determining unit 824 obtains the variation of picture element value of a block located at a posi- 
tion corresponding to that of the reference frame stored in the reference frame storing unit 821 , compares the variation 
with the threshold stored in the determination threshold storing unit 823. and determines the change in image in each 
of all blocks in the present frame from the image in the block located at the position corresponding to that in the refer- 
ence frame. 

[0364] A block information storing unit 825 stores determination results of all blocks in the present frames obtained 
by the block change determination.unit 824 as block information; 

[0365] An encoding unit 826 encodes data in a valid block which is determined to be an image-changed block com- 
pared with the corresponding block in the reference frame if the present frame is not a refresh frame, and encodes data 
after dividing all blocks in the present frame into valid blocks and invalid blocks which are determined to be image- 
unchanged blocks compared with the reference frame if the present frame is a refresh frame according to the block 
information on each block in the present frame stored in the block information storing unit 825. 
[0366] A frame switching unit 827 switches the present reference frame storing unit 821 to the present frame storing 
unit 822, and the present frame storing unit 822 to the reference frame storing unit 821 when the present frame whose 
data are encoded by the encoding unit 826 is a refresh frame. 

[0367] The reference frame storing unit 821 updates in the reference frame the image data in the block, located at the 

position corresponding to that of the block whose data are encoded by the encoding unit 826 in the present frame, to 

the encoded image data in the block in the present frame if the present frame is not a refresh frame. 

[0368] With the encoding device, the frame switching unit 827 switches the present reference frame storing unit 821 

to the present frame storing unit 822, and the present frame storing unit 822 to the reference frame storing unit 821 

when the present frame whose data are encoded by the encoding unit 826 is a refresh frame. Therefore, in a refreshing 

process, data in a reference frame can be updated at a higher speed than in a conventional method. 

[0369] Rgure 32 is the block diagram showing the configuration of the 1 1th image data encoding device. The device 

refers to an image data encoding device for encoding a series of image data, and comprises the following units. 

[0370] A reference frame storing unit 831 stores image data in a reference frame. 

[0371] A present frame storing unit 832 stores image data in the present frame (the latest frame whose data are to 
be encoded). 

[0372] A determination threshold storing unit 833 stores a threshold used in determining the existence of a change 
in image in each block of the present frame located at the position corresponding to that in the reference frame. 
[0373] A block change determining unit 834 obtains the variation of picture element value of a block located at a posi- 
tion corresponding to that of the reference frame stored in the reference frame storing unit 831 . compares the variation 
with the threshold stored in the determination threshold storing unit 833. and determines the change in image in each 
of all blocks in the present frame from the image in the block located at the position corresponding to that in the refer- 
ence frame. 

[0374] An encoding unit 835 encodes data in the valid blocks whose data have been determined to have changed 
from data in the reference frame by the block change determination unit 834. 

[0375] A determination threshold reassigning unit 836 determines whether or not a threshold presently stored in the 
determination threshold storing unit 833 is an appropriate value according to the amount of codes of data encoded by 
the encoding unit 835. If not the unit sets the determination threshold storing unit 833 to a value different from the 
threshold. 

[0376] If the determination threshold reassigning unit 836 determines that the threshold presently stored in the deter- 
mination threshold storing unit 833 is an appropriate value, then an encoded data output unit 837 outputs data encoded 
by the encoding unit 835. 

[0377] Rgure 33 is the block diagram showing the configuration of the 1 2th image data encoding device. The device 
refers to an image data encoding device for encoding a series of image data, and comprises the following units. 
[0378] A reference frame storing unit 841 stores image data in a reference frame. 

[0379] A present frame storing unit 842 stores image data in the present frame (the latest frame whose data are to 
be encoded). 

[0380] A determination threshold storing unit 843 stores a threshold used in determining the existence of a change 
in image in each block of the present frame located at the position corresponding to that in the reference frame. 
[0381 ] A block change determining unit 844 obtains the variation of picture element value of a block located at a posi- 
tion corresponding to that of the reference frame stored in the reference frame storing unit 841, compares the variation 
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with the threshold stored in the determination threshold storing unit 843, and determines the change in image in each 
of all blocks in the present frame from the image in the block located at the position corresponding to that in the refer- 
ence frame. 

[0382] A determination threshold reassigning unit 845 counts the number of valid blocks which are determined to have 
5 changes in image from a reference frame, or the number of invalid blocks which are determined to have no changes in 
image from the reference frame. Then the unit determines whether or not the threshold stored in the determination 
threshold storing unit 843 is an appropriate value according to the number of the valid blocks or the invalid blocks, if no, 
the unit sets the determination threshold storing unit 843 to a value different from the threshold. 
[0383] An encoding unit 846 encodes data in the blocks in the present frame stored in the present frame storing unit 
w 842 and determined to be valid by the determination threshold storing unit 843 if the determination threshold reassign- 
ing unit 845 determines that the threshold stored in the determination threshold storing unit 843 is an appropriate value. 
[0384] According to the 1 1th and 12th image data encoding devices, each of the determination threshold reassigning 
units 836 and 845 i determines whether- or not a threshold presently stored in the determination threshold storing units 
833 and 843 is an appropriate value according to the amount of data encoded by the encoding unit 835 (in the invention 
15 according to Claim 1 2) or according to the number of blocks determined to be valid or invalid by the block change deter- 
mining unit 844 (in the invention according to the Claim 13). If no. the units repeatedly perform a process of reassigning 
another value to the determination threshold storing units 833 and 843 until it is determined that the threshold is an 
appropriate value. When the units determine that the threshold is an appropriate value, they output encoded data of 
images in the present frame. 

20 [0385] Therefore, image data in each frame can be encoded to refer to an appropriate amount of codes according to 
the characteristics of images and a transmission rate of a transmission line. 

[0386] Figure 34 is the block diagram showing the configuration of the 1 3th image data encoding device. The device 
refers to an image data encoding device for encoding a series of image data, and comprises the following units. 
[0387] A reference frame storing unit 851 stores image data in a reference frame. 
25 [0388] A present frame storing unit 852 stores image data in the present frame (the latest frame whose data are to 
be encoded). 

[0389] A histogram generating unit 853 obtains the variation of a predetermined picture element value used as a scale 
in detecting an image change in each block in the present frame against the block located at a position corresponding 
to the image-changed block according to the image data in the reference frame stored in the reference frame storing 
30 unit 851 and the image data in the present frame stored in the present frame storing unit 852, thereby generating a his- 
togram for the variation in the entire present frame. 

[0390] A determination threshold setting unit 854 sets a determination threshold used to determine the existence of 
a change in image in each block in the present frame against the block, located at a position corresponding to the 
image-changed block in the present block, in the reference frame according to the histogram generated by the histo- 

35 gram generating unit 853. 

[0391] A block change determining unit 855 compares the variation of the predetermined picture element value in 
each block of the present frame generated by the histogram generating unit 853 with a determination threshold set by 
the determination threshold setting unit 854 so as to determine the existence of a changed image in all blocks in the 
present frame against the blocks, located at a position corresponding to an image-changed block in the present frame, 

40 in the reference frame. 

[0392] An encoding unit 856 encodes data only in valid blocks determined by the block change determining unit 855 
to have changed images in all blocks in the present frame. 

[0393] The histogram generating unit 853 can also be designed to obtain the absolute value of the difference in a pre- 
determined picture element value between picture elements in the present frame and the reference frame at the corre- 

45 sponding position in the corresponding block, obtain the maximum absolute value of the difference in each block in the 
present frame as the variation in a predetermined block, and to generate a histogram based on the variation. 
[0394] According to the 13th image data encoding device, the histogram generating unit 853 obtains the variation of 
a predetermined picture element value used as a scale in detecting an image change in each block in the present frame 
against the block located at a position corresponding to the image-changed block according to the image data in the 

so reference frame stored in the reference frame storing unit 851 and the image data in the present frame stored in the 
present frame storing unit 852, thereby generating a histogram for the variation in the entire present frame. 
[0395] The determination threshold setting unit 854 sets a determination threshold used to determine the existence 
of a change in image in each block in the present frame against the block, located at a position corresponding to the 
image-changed block in the present block, in the reference frame according to the histogram generated by the histo- 

55 gram generating unit 853. The block change determining unit 855 compares the variation of the predetermined picture 
element value in each block of the present frame generated by the histogram generating unit 853 with a determination 
threshold set by the determination threshold setting unit 854 so as to determine the existence of a changed image in alt 
blocks in the present frame against the blocks, located at a position corresponding to an image-changed block in the 
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present frame, in the reference frame. The encoding unit 856 encodes data only in valid blocks determined by the block 
change determining unit 855 to have changed images in all blocks in the present frame. 

[0396] Therefore, since a threshold can be set such that the number of valid blocks refers to a constant value based 
on the above described histogram, the optimum encoding process in which an appropriate amount of codes can be 
5 obtained for each frame depending on various conditions such as the information transmission speed of a transmission 
line, the number of transmitted frames, etc. can be performed. 

[0397] Rgure 35 is the block cfiagram showing the configuration of the 1 4th image data encoding device. The device 
refers to an image data encoding device for encoding a series of image data, and comprises the following units. 
[0398] A reference frame storing unit 861 stores image data in a reference frame. 
10 [0399] An area dividing unit 862 divides image data in the present frame into a plurality of areas. 

[0400] A determination threshold output unit 863 outputs individually a threshold used to detect the existence of a 
change in image in a plurality of blocks in each area inhabited by the area dividing unit 862 in the present frame against 
the Hock at the corresponding position in the reference frame. 

[0401] A block change determining unit 864 obtains the variation of a predetermined picture element value for each 
is block in each area obtained by the area dividing unit 862 in the present frame against the corresponding block in the 
reference frame stored in the reference frame storing unit 861 , compares the variation with the threshold applied by the 
determination threshold output unit 863. and determines whether or not a change in image is detected between blocks 
in each area in the present frame and the corresponding blocks in the reference frame. 

[0402] An encoding unit 865 encodes only valid blocks determined by the block change determining unit 864 to have 
20 changed images against the reference frame. 

[0403] A block information output unit 866 outputs the determination result of the block change determining unit 864 
as block information. 

[0404] A reference frame storing unit 861 replaces a block in the reference frame located at the position correspond- 
ing to that of a valid block in the reference frame with the valid block. 
25 [0405] Rgure 36 is the block diagram indicating an aspect of the determination threshold output unit 863. 
[0406] In Rgure 36. a threshold storing unit 863b is a memory tor storing a plurality of thresholds. 
[0407] A control unit 863a switches at predetermined intervals a threshold outputted by the threshold storing unit 863b 
to the block change determining unit 864 for each area in the present frame. 

[0408] Rgure 37 is the block diagram indicating another aspect of the above described determination threshold output 
30 unit 863. 

[0409] In Rgure 37. a threshold storing unit 863d is a memory for storing a plurality of thresholds for a plurality of 
areas in the present frame. 

[0410] A control unit 863e outputs a threshold for each area in the present frame from the threshold storing unit 863d. 
[0411] A threshold transforming unit 863f outputs a threshold for each area in the present frame from the threshold 
35 storing unit 863d to the block change determining unit 864 after modifying the threshold at a predetermined frame inter- 
val. The threshold modifying process is performed by, for example, an arithmetic operation. 

[0412] According to the 14th image data encoding device, the area dividing unit 862 divides the image data in the 
present frame into a plurality of areas. Then, the block change determining unit 864 determines the change in image 
against the data in the corresponding block in the reference frame using a threshold for each area inputted by the deter- 

40 mination threshold output unit 863 for each block in each area. According to the above described determination result, 
the encoding unit 865 encodes only valid blocks determined to have an image changed against the data in the refer- 
ence frame. The block information output unit 866 outputs the above described determination result as block informa- 
tion. Furthermore, the reference frame storing unit 861 replaces a block in the reference frame with the valid block 
located at the corresponding position in the present frame. 

45 [0413] Therefore, the determination threshold output unit 863 refreshes image data in each area in the reference 
frame and solves the image deterioration problem due to the above described error by modifying the threshold output- 
ted for each area in the present frame at predetermined frame intervals, in the refreshing process, since only valid 
blocks are encoded, the increment of the amount of codes can be minimized. 

[0414] Furthermore, a process of reducing an error in each area in the reference frame against the original image can 
so be performed after dividing a frame into a plurality of frames and performed on them in a predetermined order. Thus, 
the error can be gradually reduced. That is, the entire areas are not simultaneously refreshed as in the conventional 
method, but the refreshing process can be performed in area units over a plurality of frames. Therefore, an unnatural 
image in which the image flashes during the refreshing process can be prevented. 

[041 5] That is, according to the determination threshold output unit 863 with the configuration shown in Figure 36. the 
55 control unit 863a controls the correlation between a plurality of thresholds stored by the threshold storing unit 863 and 
each area in the present frame such that the correlation is changed at predetermined frame intervals. Therefore, a 
threshold outputted for each area in the present frame can be modified at predetermined frame intervals. For example, 
according to the determination threshold output unit 863 with the configuration shown in Figure 37. the control unit 863e 
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outputs a predetermined threshold to each area in the present frame from the threshold storing unit 863d, and the 
threshold transforming unit 863f outputs to the block change determining unit 864 a threshold outputted corresponding 
to each area after modifying it at predetermined frame intervals. Thus, a threshold outputted corresponding to each 
area in the present frame can be modified at predetermined frame intervals, thereby successfully obtaining the above 
5 described effect. 

[0416] Figure 38 is a flowchart indicating the 6th image data encoding method as an embodiment of the present 
invention. 

[041 7] According to this encoding method, as shown in Figure 38, a picture element in the first block in a frame appOed 
to and stored in an image buffer (hereinafter referred to as a present frame) is compared with that in the corresponding 
10 block in the reference frame so that the first block in the present frame is a valid block having a change in image against 
the present frame (S1 01 ). 

[0418] A valid block determination can be made through each of the following methods (1). (2), and (3), etc. 

(1) The sum of absolute values of differences between picture elements (gradation values, for example) in each 
is block in the present frame and those in the corresponding block in the reference frame is obtained, and a block hav- 
ing a total value larger than a predetermined threshold is considered to be a valid or block. According to this 
method, a determination is made based on a total value. Thus, a change in an entire block can be checked. 

(2) The above described absolute value of difference is obtained for each block in the present frame. If the maxi- 
mum value in these absolute values of differences is larger than a predetermined threshold, the block is considered 

20 to be valid. Since only an absolute value of a difference must be detected in this method, the detecting process can 
be performed at a high speed with a relatively simple circuit. 

(3) The sum of square numbers of differences between picture elements (gradation values, for example) in each 
block in the present frame and the corresponding block in the reference frame is obtained. If the sum is larger than 
a predetermined threshold, the block is considered to be valid. Since a block is determined according to the sum 

25 of square numbers of differences in picture elements in this method, the variation is emphasized. Therefore, a 
change in one block can be visually checked exactly. 

[041 9] If the first block is a valid block, change information indicating a valid block is written to a corresponding position 
in the block information storing unit fr for example) (S102). 

30 [0420] Then, the image data in the first block are encoded through the ADCT, etc. (S103), and the data in the first 
block in the reference frame are updated to the contents of the first block in the present frame (S104). 
[0421 ] If it is determined that the first block in the present frame is invalid, that is, has no change in image in the deter- 
mining process in step S1 , change information indicating an invalid block ("0", for example) is written in the correspond- 
ing position in the block information storing unit (S105). 

35 [0422] Then, the processes in steps S1 - S5 are repeated on all blocks in and after the 2nd block in the present frame, 
change information indicating a valid block or an invalid block is written in the block information storing unit for all blocks 
in the present frame, and the data in the reference frame are updated by rewriting the data in the blocks to the data in 
the corresponding block in the present frame if the corresponding blocks in the present frame are determined to be 
valid. 

40 [0423] If it is determined that the processes in steps S101 through S105 have been performed for all blocks in the 
present frame ("Yes" in S106). then it is determined whether or not the present frame is a refresh frame (S107). If yes, 
the change information for all blocks in the present frame stored in the block information storing unit is sequentially read 
from the first block (S108). and it is determined whether or not each block is valid or invalid (S109). Then, the data in 
invalid blocks only are encoded as in the above described valid blocks (S1 1 0), and then the reference frame is updated 

45 by rewriting the data in the blocks to the contents of the blocks in the present frame if the corresponding blocks in the 
present frame are invalid (Si 11). 

[0424] rf it is determined that the processes in steps S109 through S1 1 1 have been performed ("Yes" in S1 12), then 
the image data encoding process is completed for the present frame. 

[0425] Thus, first in the encoding method, image data in valid blocks are encoded, and then image data in invalid 
so blocks are encoded if the present frame is a refresh frame. If blocks are encoded, the corresponding blocks in the ref- 
erence frame are replaced with the encoded blocks in the present frame. 

[0426] Therefore, in a normal frame other than a refresh frame, data in a valid block are encoded. Only when a frame 
is a refresh frame, all blocks are encoded in the order of valid blocks and invalid blocks. 

[0427] Figure 39 shows the operation in time series of encoding data in a frame in a sending equipment and recon- 
55 structing an original image from transmitted encoded data in a receiving equipment when the moving image have been 
encoded in frame units by the above described image data encoding method and transmitted to the receiving equip- 
ment where the original image is reconstructed from the encoded data. Figure 39 indicates the difference in a process 
of reconstructing an original image in a refresh frame in a reconstructing equipment between the conventional image 
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data encoding method shown in Figure 5 and the image data encoding method according to the 6th image data encod- 
ing method. 

[0428] As shown in Figure 5, when images are reconstructed by the conventional encoding method, an encoding time 
interval is not synchronized with reconstruction time intervals and the reconstruction of the 3rd frame is performed at 

5 time T 4 . not at time T 3 , if the codes in a refresh frame (the 3rd frame, start-of-encoding time t 3 ) are not transmitted by 
the start-of-encoding time tj. Thus, the reconstruction results in an unnatural image displayed on the receiving equip- 
ment. On the other hand, since an image in a refresh frame (the 3rd frame) is reconstructed from encoded data only in 
valid blocks at time T 3 in a method according to the present embodiment, the above described synchronization between 
an encoding time interval and a reconstruction tome interval can be prevented, and the reconstructed image is not dis- 

io played unnaturally on the receiving equipment. Then, since an image in a refresh frame (the 3rd frame) is reconstructed 
completely from encoded data with invalid blocks included at the reconstruction time T 4 and the image in the refresh 
frame (the 3rd frame) is reconstructed from encoded data in valid blocks at the reconstruction time T 3 , an operator feels 
that.the receiving equipment is assigned the shortest possible wait time when the image in the refresh frame is recon- 
structed. 

15 [0429] Furthermore, since a refresh frame containing a large amount of codes is encoded after being divided into valid 
blocks and invalid blocks, and the encoded data in valid blocks are transmitted prior to those in invalid blocks, the capac- 
ity of a code buffer both in the sending and receiving equipments can be reduced than the conventional method. 
[0430] Figure 40 is the block diagram indicating the circuit configuration of the 15th image data encoding device for 
encoding image data according to the 6th image data encoding method. 

20 [0431 ] An image buffer 1 020 stores image data in one frame (present frame) applied through an input terminal 1010, 
and outputs the data in block (8x8 picture elements, for example) units in a predetermined order to a block change 
determining unit 1040 and an encoding unit 1060. 

[0432] A reference frame storing unit 1030 is a memory for storing image data in a reference frame which are com- 
pared with the image data in the present frame stored in the image buffer 1020. The contents of the reference frame 

25 storing unit 1030 are sequentially rewritten according to block information in each block in the latest frame (present 
frame) applied from a block information storing unit 1 050. and are used as image data in the reference frame. 
[0433] The block change determining unit 1 040 compares the image data in each block transmitted from the image 
buffer 1020 with the data in the corresponding block in the reference frame stored in the reference frame storing unit 
1030. obtains (1) the sum of absolute values of the differences in picture element values, (2) the maximum absolute 

30 value of differences in image or picture element values, or (3) the sum of average square numbers of differences in 
image or picture element values, compares one of the values with a threshold stored in a determination threshold stor- 
ing unit 1 070. and determines whether each block in the present frame is valid (the above descrfoed value is equal to 
or larger than the threshold) or invalid (the above described value is smaller than the threshold). 
[0434] The block information storing unit 1050 stores block information (indicating that the present block is valid or 

35 invalid) of each block in the present frame written by the block change determining unit 1 040, and the block information 
is outputted to an encoding unit 1 060, the reference frame storing unit 1 030, and an output terminal 1 090. 
[0435] The reference frame storing unit 1 030 receives from the image buffer 1 020 a valid block having the block infor- 
mation indicating a valid block, and replaces the corresponding block in the reference frame with the valid block. 
[0436] The encoding unit 1 060 refers to the block information of each block stored in the block information storing unit 

40 1050 when the data of each block of image data in the present frame are sent from the image buffer 1020 in a prede- 
termined order. If a refresh signal r described later is not received, data in the blocks indicated as Valid" by the block 
information are encoded to variable-length data, and the encoded data are outputted from the output terminal 1070. 
[0437] A refresh signal r indicates that the present frame stored in the present image buffer 1020 is a refresh frame, 
and is applied externally from a control unit not shown in Figure 40 through an input terminal 1080. The refresh signal 

45 r is applied to the image buffer 1020, the block information storing unit 1050, and the encoding unit 1 060. 

[0438] On receiving the refresh signal r. the image buffer 1020 repeats two times the operation of outputting image 
data in all blocks in the present frame to the encoding unit 1060 sequentially from the first block. The block information 
storing unit 1050 also repeats two times the operation of outputting image data in all blocks in the present frame to the 
encoding unit 1060 sequentially from the first block synchronously with the above described operation. 

so [0439] On receiving a refresh signal r, the encoding unit 1060 first encodes only the blocks identified as valid blocks 
according to the block information, and second encodes the block identified as invalid blocks according to the block 
information. Therefore, the encoding unit 1060 divides a refresh frame into valid block data and invalid block data, and 
encodes and outputs them in this order. 

[0440] Figure 41 is the block diagram indicating the circuit configuration of the 16th image data encoding device for 
55 encoding image data according to the encoding method indicated in the flowchart shown in Figure 38. 

[0441] In Figure 41, a circuit block also shown in Figure 40 as a function of the image data encoding device is 
assigned the same name and number with the detailed explanation omitted here. 

[0442] The 15th image data encoding device shown in Figure 40 is externally provided with a refresh signal r, while 
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the 16th image data encoding device shown in Figure 41 is internally provided with a counter 1024 for generating a 
refresh signal at predetermined frame interval. 

[0443] The counter is an up-counter for counting the number of frames at predetermined time intervals, for example, 
and outputs a refresh signal r to the image buffer 1022, the block information storing unit 1050, and the encoding unit 
5 1060 when a counter value has reached a predetermined value, that is, at predetermined frame intervals. 

[0444] On receiving a refresh signal r, the image buffer 1 022, the block information storing unit 1 050, and the encoding 
unit 1060 encode image data in the present frame as described above in the order of valid blocks first and then invalid 
blocks. 

[0445] The image buffer 1 022 stores image data in one frame which are applied through the input terminal 1010, and 

10 outputs a reset signal R to the counter 1 024 at a predetermined timing (for example, after the process of encoding the 
image in the refresh frame has been performed) when it receives a refresh signal r from the counter 1 024. 
[0446] Trie counter 1024 is reset to a predetermined initial value (0. for example) on receiving a reset signal R. 
[0447] Figure 42 shows an example of a configuration of the encoding unit 1060. The encoding unit 1060 shown in 
Figure 42 comprises a two-dimensional DCT unit 1061. a linear quantizing unit 1062, a quantization matrix (quantiza- 

75 tion threshold) 1063. and an encoding table 1065. The configuration of the unit is similar to that of the conventional 
static image encoding device shown in Figure 1. That is, it is different from the conventional device in that it does not 
contain the block buffer 120. The encoding table 1065 is used so that the variable-length encoding unit 1064 can effi- 
ciently encode the combination of a run length and a quantized coefficient outputted in block units from the linear quan- 
tizing unit 1 062. For example, it is a table used in an entropy encoding method such as a Huffman code table, arithmetic 

20 operation code table, etc. 

[0448] Thus, according to the present embodiment, a refresh frame is divided into valid blocks and invalid blocks, and 
the data in the valid blocks are first encoded and transmitted, and then the data in the invalid blocks are encoded and 
transmitted. Therefore, a reconstructing equipment (a receiving equipment) can reconstruct original images from 
refresh frames through a sort of hierarchical reconstruction. Therefore, an operator for the reconstructing equipment 

25 feels that his or her wait time is not very long in successfully reconstructing an original image. 

[0449] Thus, the capacity of the code buffer for temporarily storing encoded data of images in frames both in encoding 
reconstructing equipments by encoding the data in refresh frames after dividing them into two block groups. 
[0450] When images are refreshed, that is, when data in a refresh frame are encoded, a reference image stored in 
the reference frame 1 030 should be replaced with the data in the refresh frame. In this case, the image data in all blocks 

30 in one frame stored in the reference frame 1030 should be updated to the above described image data in the refresh 
frame. 

[0451] The following embodiment updates at a high speed the reference frame when the refreshing process is per- 
formed. 

[0452] Figure 43 is the flowchart indicating the 7th image data encoding method. 
35 [0453] A function also shown in Figure 38 as that of the 6th image data encoding method is assigned the same symbol 
(step number). 

[0454] In this embodiment, it is first determined as in the above described 6th image data encoding method whether 
blocks in the present frame are valid or invalid, and change information (block information) indicating whether blocks are 
valid or invalid is stored (S101 - S103, S105 and S106). That is, up to this point, the data in the reference frame have 
40 not been updated. 

[0455] Next, it is determined whether or not the present frame is a refresh frame (Si 07). If no ("No" in S107), valid 
blocks in the present frame replace the corresponding blocks in the reference frame according to the change informa- 
tion stored as described above, thereby updating the reference frame (S121). 

[0456] If it is determined that the present frame is a refresh frame in step S107 ("Yes" n S107), then it is determined 
45 whether the blocks are valid or invalid according to the stored change information (S109), and the data in the invalid 
block are encoded (S1 1 0). When the process has been performed on all blocks ("Yes" in S1 1 2), then the frame memory 
for storing image data in the reference frame (reference frame memory) is replaced with the present frame memory for 
storing image data in the present frame, while the present frame memory is replaced with the reference frame memory 
for storing image data in the reference frame (S122). 
so [0457] Therefore, the image data applied next are applied to and stored in the frame memory hitherto used as a ref- 
erence frame memory, and compared with the image data in the refresh frame stored in the frame memory hitherto 
used as the present frame memory. That is, according to the process in step S122, a process of updating a reference 
frame to be performed in a refreshing process can be instantaneously performed without any trouble. 
[0458] Thus, in the 7th image data encoding method, since the functions of the reference frame memory and the 
55 present frame memory are switched to each other each time a refreshing process is performed, it is not necessary to 
rewrite the image data in all blocks in the reference frame to those in the present frame. Therefore, the reference frame 
memory can be updated instantaneously in a refreshing process. 

[0459] Figure 44 shows the circuit configuration of the 17th image data encoding device for encoding image data 
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according to the encoding method indicated in the flowchart shown in Figure 43. 

[0460] In Figure 44, a circuit block also shown in Figure 40 as a function of the 1 5th image data encoding device is 
assigned the same name and number with the detailed explanation omitted here. 

[0461] The image data encoding device shown in Figure 44 is realized by providing the device shown in Figure 40 
5 with a switch 2010 for switching the reference frame storing unit 1030 and the image buffer (present memory) 1020 
alternately in a refreshing process. 

[0462] The switch 20 1 0 receives a refresh signal r from an external control unit through the input terminal 1 080. Each 
time the refresh signal r is applied, the switch 2010 switches the destination of image data in one frame (input frame) 
applied through the input terminal 1010 alternately to the image buffer 1020 and the reference frame storing unit 1030 
10 after the above described refreshing process has been performed (after encoding the data in all blocks in the input 
frame). As a result each time a refresh signal r is applied, the image buffer 1020 and the reference frame storing unit 
1030 exchange their functions after a refreshing process has been performed. 

[0463] Since the reference frame storing unit 1030 as being switched to an image buffer or the image buffer 1020 
stores the image data in the present frame at present, the above described switching operation by the switch 2010 can 
15 update the images in the reference frame instantaneously in a refreshing process without transferring (copying) from 
the image buffer to the reference frame storing unit the data in all blocks in the latest frame to be stored in the reference 
frame storing unit according to a conventional method. 

[0464] The level of the variation in moving between adjacent frames depends on the type of image. Therefore, if a 
threshold (hereinafter referred to as a determination threshold) used for valid blocks and appropriate to a mobile image 

20 is applied to a static image, then the value is too large for the image to be successfully detected as valid blocks although 
each of them affects the quality of the whole reconstructed image. On the other hand, if a determination threshold used 
to recognize static blocks as valid blocks, that is, appropriate to a static image, is applied to a mobile image, then the 
number of valid blocks becomes too large and the total amount of codes increases greatly. 
[0465] The following embodiment has been developed to solve the above described problem. 

25 [0466] First. Figure 45 is the flowchart indicating the important operation of the 8th image data encoding method 
according to the embodiment. 

[0467] First, any of (1 ) the sum of absolute values of the differences in image or picture element values, (2) the max- 
imum absolute value of differences in image or picture element values, and (3) the sum of average square numbers of 
differences in image or picture element values is obtained for all block in a frame. Then, it is determined whether or not 

30 any of them is equal to or larger than a determination threshold T, all valid blocks having any of the above described 
values equal to or larger than the determination threshold are extracted, and the valid blocks are encoded (S131). 
[0468] Then, if the amount of codes obtained by the above described encoding process (sum of the amount of codes 
in all valid blocks) is calculated, the obtained amount of codes is compared with a predetermined appropriate amount 
of codes (S132), and the obtained amount of codes is smaller than the appropriate amount of codes ("No" in S132), 

35 then the above described determination threshold is reduced (S133). and control is returned to the process in step 
S131. 

[0469] If the calculated amount of codes is larger than the appropriate amount of codes ("Yes" in S132), then it is 
determined whether or not the difference between the amount values is smaller than a predetermined value (S134). If 
it is larger ("No" in S134). then the value of the determination threshold T is raised (S135), and control is returned to the 
40 process in step S132. On the other hand, if the difference between the amount values is smaller than a predetermined 
value ("Yes" in S134), then the determination threshold T is not changed. 

[0470] Thus, the determination threshold T is changed until the sum of the amount of codes in valid Wocks (calculated 
amount of codes) is equal to or larger than the appropriate amount of codes and the difference is smaller than a prede- 
termined value. Then, the modification of the determination threshold T is stopped when the sum of the amount of 
45 codes in valid Wocks has reached an appropriate value, thereby terminating a process of encoding valid blocks (method 
I). 

[0471] In the above described method, a determination threshold T is reset according to the amount of codes 
obtained in an encoding process. Since the amount of codes varies in proportion to the number of encoded blocks, that 
is, the number of valid blocks, the number of valid blocks can be counted without performing an encoding process, and 

so the determination threshold T can be modified until the amount of codes becomes equal to the appropriate value 
according to the number of valid blocks obtained by the above counting operation (method II). In this method II, since 
the determination threshold T can be set at a speed higher than method I, and the encoding process must be performed 
only once, the process of encoding the present frame can be completed at a speed higher than method I. 
[0472] Furthermore, adjacent frames indicate very similar images in processing moving. Therefore, a determination 

55 threshold T can be a value used in encoding image data in the preceding frame, and can be modified (set) after the 
encoding process, thereby speeding up the encoding process (method III). 

[0473] In the above described three methods, the determination threshold T is set each time the data in each frame 
are encoded. However, since the variation between frames is almost constant in a series of moving images (since 
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images in a series of frames are similar), the determination threshold (T) setting process by each of the above 
described methods is performed on the first n frames (n=1 , 2. 3, ...), and the encoding process on the n-th and the fol- 
lowing frames (the (n+1)th frame) is performed using the determination threshold T determined in any of the preceding 
frames so that the time taken for encoding the data in the (n+ 1 ) and the following frames can be shortened. 
5 [0474] Figure 46 is the block diagram showing the circuit of the 1 8th image data encoding device for encoding image 
data in a frame after flexibly setting a determination threshold T by the above described method I so that the amount of 
codes is appropriate. 

[0475] In Figure 46, a circuit block also shown in Figure 40 as a function of the 15th image data encoding device is 
assigned the same name and number with the detailed explanation omitted here. 
10 [0476] The encoding unit 1060 sequentially reads from the block information storing unit 1040 the block information 
in each block in the present frame in a predetermined order, and encodes the data in valid blocks only. Then, on having 
encoded the data in one frame, the encoding unit 1 060 transfers the encoded data in one frame to a code amount deter- 
mining unit 3010. 

[0477] The code amount determining unit 3010 determines whether or not the transferred amount of codes in the 
15 present frame is appropriate, rf yes, the unit sends a send enable signal PE to a switch 301 2. 

[0478] On receiving the send enable signal PE, the switch 301 2 externally outputs from the output terminals 1 070 and 
1090 respectively the encoded data in the present frame stored in the encoding unit 1060 and the block information on 
all blocks in the present frame stored in the block information storing unit 1050. 

[0479] If the code amount determining unit 1 060 determines that the amount of codes in the present frame does not 
20 refer to an appropriate value, it sends a determination threshold rewrite signal RE T to a determination threshold storing 
unit 3014, and sends a re-read signal RR to an image buffer 3016. 

[0480] The determination threshold storing unit 301 4 modifies a determination threshold T according to the instruction 
transmitted as a determination threshold rewrite signal RE T (instruction to raise or reduce the determination threshold 
T). 

25 [0481] The block change determining unit 1040 generates using the modified determination threshold T the block 
information as to whether each image data block in the present frame transmitted again from the image buffer 3016 is 
valid or invalid, and transfers the block information to the block information storing unit 1050. 
[0482] Then, the encoding unit 1060 encodes according to the newly obtained block information only valid blocks in 
the image data in the present frame transmitted again from the image buffer 3016, and outputs the obtained encoded 

30 data of the image data in the present frame to the code amount determining unit 301 0. 

[0483] The code amount determining unit 3010 determines whether or not the amount of the transmitted encoded 
data is appropriate. 

[0484] Thus, the determination threshold storing unit 3014 modifies the determination threshold T until the code 
amount determining unit 3010 determines that the amount of codes is appropriate. Then, the code amount determining 
35 unit 3010 sends a send enable signal PE to the switch 3012 when the amount of codes of image data in the present 
frame is appropriate according to the modified determination threshold T. Thus, the encoded data of the image data in 
the present frame and the block information on each block in the present frame are externally outputted to the terminals 
1070 and 1090 through the switch 3012. 

[0485] The image data in each frame are thus encoded such that the amount of codes constantly is appropriate, and 
40 the encoded data and the block information on ail blocks are outputted. Therefore, even if a reconstructing equipment 
for reconstructing original images from the encoded data receives encoded data relating to only valid or blocks accord- 
ing to the block information, the corresponding blocks to the valid blocks can be correctly updated. 
[0486] Figure 47 shows the configuration of the 19th image data encoding device for encoding image data in each 
frame according to the above described method II. 
45 [0487] in Figure 47, a circuit block also shown in Figure 40 as a function of the 1 5th image data encoding device is 
assigned the same name and number. 

[0488] In this device, a block change determining unit 3020 transmits block information indicating whether each block 
in the present frame is valid or invalid to a number-of-valid-blocks determining unit 3022 as well as to the block informa- 
tion storing unit 1050. 

so [0489] The number-of-valid-blocks determining unit 3022 counts the number of valid blocks through a built-in counter, 
etc., and determines whether or not the number of valid blocks in the present frame is appropriate. If the number of valid 
blocks is appropriate, the number-or-valid-blocks determining unit 3022 sends a send enable signal PE to a switch 3024 
and issues an encode instruction to an encoding unit 3029. On receiving the instruction, the encoding unit 3029 refers 
to the block information stored in the block information storing unit 1050, and encodes image data only in the valid 

55 blocks in the present frame. 

[0490] On receiving the signal PE after the encoding unit 1 060 has completed its encoding process, the switch 3024 
externally outputs from the terminals 1070 and 1090 respectively the encoded data of image data in the valid block in 
the present frame stored in the encoding unit 3029, and the block information on each block in the present frame stored 
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in the Hock information storing unit 1050. 

[0491 ] When the number-or-valid-blocks determining unit 3022 determines that the number of valid blocks in the 
present frame obtained using the present determination threshold T does not refer to an appropriate value, it sends a 
determination threshold rewrite signal RE T instructing the determination threshold storing unit 3026 to rewrite the deter- 
5 mi nation threshold T, and sends a re-read signal RR to an image buffer 3028. 

[0492] The determination threshold storing unit 3026 modifies the determination threshold T according to the deter- 
mination threshold rewrite signal RE T transmitted from the number-of-valid-blocks determining unit 3022 (instructing to 
raise or reduce the determination threshold T). 

[0493] The block change determining unit 3020 generates according to the modified determination threshold T block 
w information indicating whether each block of image data in the present frame transmitted from the image buffer 3028 is 
valid or invalid. 

[0494] Then, the above described operation is repeats until the number-of-vaW-blocks determining unit 3022 deter- 
mines that the number of the valid blocks in the present frame is appropriate. If the determination threshold storing unit 
3026 sets an appropriate determination threshold T to the image data in the present frame, and the number of the valid 
15 blocks in the present frame is appropriate, then the encoded data of the valid blocks in the present frame encoded by 
the encoding unit 1060 and the block information on all blocks in the present frame are externally outputted from the 
terminals 1070 and 1090 respectively through the switch 3024. 

[0495] Thus, the image data in each frame are thus encoded such that the amount of codes constantly is appropriate, 
and the encoded data and the block information on all blocks are outputted. Therefore, even if a reconstructing equip- 
20 ment for reconstructing original images from the encoded data receives encoded data relating to only valid blocks 
according to the block information, the corresponding blocks to the valid blocks can be correctly updated. 
[0496] Figure 48 shows the configuration of the 20th image data encoding device for encoding image data in each 
frame according to the above described method III. 

[0497] In Figure 48, a circuit block also shown in Figure 40 as a function of the 15th image data encoding device is 
25 assigned the same name and number. 

[0498] A code amount determining unit 3030 determines whether or not the amount of image data in the present 
frame applied from the encoding unit 1060 is appropriate. If no. the unit sends a determination threshold rewrite signal 
RE T to the determination threshold storing unit 3014. 

[0499] On receiving the determination threshold rewrite signal RE T , the determination threshold storing unit 3014 
30 modifies the determination threshold T according to the instruction of the signal (to raise or reduce the determination 
threshold T). 

[0500] The determination threshold T modified by the determination threshold storing unit 3014 is used when the 
block change determining unit 1040 determines whether each block of image data in the succeeding frame is valid or 
invalid. 

35 [0501 ] In this device, the block change determining unit 1 040 determines whether each block in the present frame is 
valid or invalid using the determination threshold T set by the determination threshold storing unit 301 4 according to the 
result of the image data encoding process performed on the preceding frame. Then, the encoding unit 1060 encodes 
only the blocks determined to be valid according to the determination above. 

[0502] Then, the encoded data of the image date in the present frame provided by the encoding unit 1060 and the 
40 block information on each block in the present frame stored in the block information storing unit 1 050 are externally out- 
putted respectively through the terminals 1070 and 1 090 immediately after being encoded. 

[0503] Thus, with the device, it is determined whether a block is valid or invalid using a determination threshold T set 
according to the result of the encoding process performed on the preceding frame regardless of the appropriateness of 
the amount of codes of encoded data in the present frame. If the amount of encoded data in the present frame obtained 

45 by the encoding process using the determination threshold T is not appropriate at ail. then the determination threshold 
T modified by the determination threshold storing unit 3014 is used in encoding the image data in the succeeding frame. 
[0504] That is, the device can shorten the time taken for modifying a determination threshold T and speed up an 
encoding operation by taking advantage of the feature that adjacent frames indicate similar images in moving data. 
[0505] Figure 49 shows the configuration of the 21st image data encoding device for encoding image data in each 

so frame according to the above described method III. 

[0506] In Figure 49, a circuit block also shown in Figure 40 as a function of the 19th image data encoding device for 
encoding image data according to the above described method III is assigned the same name and number. 
[0507] In the device, the function of a number-of -valid-blocks determining unit 3040 is different from that of the 
number-of-valid-blocks determining unit 3022. and the switch 3024 provided for the device shown in Figure 47 is not 

55 provided in the present device. 

[0508] Like the number-of-vaJid-blocks determining unit 3022, the number-of-valid-blocks determining unit 3040 
counts the number of valid blocks in the present frame according to the result of the determination by the block change 
determining unit 3020, and determines whether or not the number of valid blocks is appropriate. The number-of-valid- 
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blocks determining unit 3040 outputs a determination threshold rewrite signal RE T to the determination threshold deter- 
mining unit 3026 only when the number of valid blocks is not appropriate. 

[0509] Then, as described above, the determination threshold storing unit 3026 modifies the determination threshold 
T according to the instruction of the determination threshold rewrite signal RE T . 
s [0510] The modified determination threshold T is used when the block change determining unit 3020 determines 
whether each block in the succeeding frame is valid or invalid. 

[051 1] The block information in each block in the present frame obtained by the block change determining unit 3020 
is stored in the block information storing unit 1050 and outputted to the reference frame storing unit 1 030. The encoding 
unit 1 060 sequentially reads the block information in each block in the present frame stored in the block information stor- 
w ing unit 1050, and encodes only valid blocks in all blocks of image data in the present frame stored in the image buffer 
1020 according to the block information. 

[0512] The block information in each block in the present frame stored in the block information storing unit 1050 and 
the data in the present frame encoded by the encoding unit 1060 are externally outputted through the terminals 1070 
and 1090 respectively. 

is [0513] Thus, with the device, it is determined using the determination threshold T set according to the result of the 
encoding process performed on the preceding frame whether or not each block in the present frame is valid. Only 
blocks determined to be valid are encoded and outputted externally together with the block information on the blocks. 
The determination threshold T modified by the determination threshold storing unit 3026 according to the number of 
valid blocks obtained in the encoding process is used in determining a valid block when image data in the succeeding 

20 frame are encoded. 

[0514] Thus, unlike the device shown in Figure 48, the device sequentially modifies the determination threshold Tfor 
each frame according to the number of valid blocks, not according to the amount of codes, to obtain the effect provided 
by the device shown in Figure 48. 

[0515] According to the image data encoding device operated by method I or II, a determination threshold T used in 
25 determining a valid block can be set to an appropriate value according to the type of image, a transmission rate of a 
transmission line. etc. That is, when ten pieces of images must be transmitted every second via an ISDN (integrated 
service digital network) of. for example, 64Kb/s, valid block determination is made using a determination threshold T 
and only blocks determined to be valid are encoded. At this time, if the amount of codes in one frame exceeds 6400 
bits, the image cannot be transmitted at a rate of 1 0 pieces per second. On the other hand, if the amount of codes in 
30 one frame is far below 6400 bits, then the low quality image is transmitted. 

[051 6] In this case, according to the 3rd embodiment, encoded data can be transmitted after the determination thresh- 
old T has been modified (set again) until the amount of codes has reached a desirable value (6400 bits in this case). 
Accordingly, a desirable image transmission can be performed depending on the number of pieces of transmitted 
images per unit time. 

35 [051 7] Next, an embodiment having the effects of the 1 8th through 21 st image data encoding devices is explained 
below. 

[0518] Figure 50 is the flowchart explaining the 9th image data encoding method according to the above described 
embodiment. 

[0519] According to the encoding method, a process of obtaining a predetermined variation in image or picture ele- 
40 merit value (for example, (1 ) a sum of absolute values of differences, (2) the maximum absolute value of difference, or 
(3) sum of square numbers of differences, etc.) between corresponding blocks in the present frame and the reference 
frame is performed on all blocks (S141). Then, the number of blocks is calculated for the variation in image or picture 
element value to obtain a histogram of the variation in image or picture element value ($142). 
[0520] Then, according to the obtained histogram, a determination threshold T is determined to detect valid blocks 
45 (S143). The determination threshold T is based on the reference value of 10% of the number of blocks in one frame, 
with the number of blocks integrated sequentially from the largest variation in image or picture element value until the 
result has reached the reference value or the approximation of the reference value. Then, the minimum value of the var- 
iation in image or picture element value is set as the determination threshold T. 

[0521] Then, the variation in image or picture element value is compared with the determination threshold T for ail 
so blocks in the present frame, and it is determined that a block in which the variation in image or picture element value is 
equal to or larger than the determination threshold T is determined to be an image-changed block compared with the 
corresponding block in the reference frame. An image-changed block, that is, a valid block, is encoded (S144 through 
S146). 

[0522] The processes in steps S1 41 through S1 46 are performed on all the other frames. When it is determined that 
55 the encoding process has been performed on all valid blocks in all frames ("Yes" in S147), then the encoding process 
terminates. 

[0523] Figure 51 is the block diagram showing the circuit configuration of the 22nd image data encoding device for 
encoding image data in each frame according to the 9th image data encoding method. 
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[0524] In Figure 51 , each of the image buffer 1 020, the reference frame storing unit 1 030, the block change determin- 
ing unit 1040, the block information storing unit 1050, and the encoding unit 1060 has the function identical to that of 
the circuit block assigned the same name and number used in the above described image data encoding devices. 
[0525] A frequency calculating unit 401 0 obtains the variation in image or picture element value (for example, the max- 

5 imum absolute value of difference) between each block in the present frame stored in the image buffer 1020 and the 
corresponding block in the reference frame stored in the reference frame storing unit 1 030, and then the frequency (the 
number of blocks) is calculated for each value of the variation in image or picture element value. That is, a histogram of 
the variation in image or picture element value is obtained with the frequency represented by the number of blocks. 
Then, on generating the histogram, the frequency calculating unit 4010 outputs a determination threshold rewrite signal 

w RE T to a determination threshold setting unit 401 2. 

[0526] The determination threshold setting unit 401 2 sequentially enters the frequency (the number of blocks) of var- 
iation in image or picture element from the frequency calculating unit 4010 in the order from the largest variation in 
image or pictureelement valuerand then sequentially irttegrates the frequency (the num 

grated value has reached a predetermined level (for example, approximately 10% of all blocks in one frame), the deter- 
is mination threshold setting unit 4012 sets the determination threshold T to the value of the variation in image or picture 
element obtained as integrated frequency (the number of blocks) in the last step of the calculating process, that is. the 
value of the minimum variation in image or picture element as integrated frequency (the number of blocks). 
[0527] If the determination threshold T is thus set. the block change determining unit 1040 receives the image data 
in the present frame and the reference frame respectively from the image buffer 1020 and the reference frame storing 
20 unit 1 030. and determines using the determination threshold T whether each of the blocks in the present frame is valid 
of invalid. The valid/invalid determination can be performed by obtaining again the variation in image or picture element 
value for each block in the present frame, and comparing the resultant value wfth the determination threshold T. As a 
result, the block change determining unit 1 040 outputs to the block information storing unit 1 050 the block information 
indicating that each of the blocks in the present frame is valid or invalid (for example, T for a valid block and T>" for an 
25 invalid block). 

[0528] The encoding unit 1060 sequentially reads in a predetermined order from the block information storing unit 
1050 the block information about each block in the present frame stored in the image buffer 1020, and then encodes 
only the data in valid blocks. When the encoding unit 1060 has encoded the data in all valid blocks in the present frame, 
the encoding unit 1060 outputs through the terminal 1070 the encoded data obtained by the above described encoding 
30 process, and the block information storing unit 1 050 outputs through the terminal 1090 the block information about each 
block in the present frame. 

[0529] Figure 52 is the block diagram showing the configuration of the 23th image data encoding device for, as in the 
22th image data encoding device, encoding image data according to the method indicated by the flowchart shown in 
Figure 50. 

35 [0530] In Figure 52, each of the image buffer 1 020, the reference frame storing unit 1 030, and the encoding unit 1 060 
has the function identical to that of the circuit block assigned the same name and number used in the above described 
15th image data encoding devices shown in Figure 39. 

[0531 ] A image or picture element change calculating unit 4020 receives the image data in the present frame and the 
reference frame respectively from the image buffer 1020 and the reference frame storing unit 1030. and. like the fre- 
40 quency calculating unit 4010 of the image data encoding unit shown in Figure 22, obtains the variation in image or pic- 
ture element value (for example, the maximum absolute value of difference) for each block in the present frame, and the 
results are temporarily stored in the block information storing unit 4022. 

[0532] On receiving and storing the variation in image or picture element value for each of the blocks in the present 
frame from the image or picture element change detecting unit 4020, the block information storing unit 4022 outputs a 

45 determination threshold rewrite signal RE T to a determination threshold setting unit 4024. 

[0533] The determination threshold setting unit 4024 reads from the block information storing unit 4022 the variation 
in image or picture element value for all blocks in the present frame, generates a histogram for each value with the fre- 
quency represented as the number of blocks, and sets the histogram to, for example, a determination threshold T 
according to the above described method. Then, the determination threshold setting unit 4024 receives from the block 

so information storing unit 4022 the variation in image or picture element value for each block in the present frame, 
sequentially compares the variation in image or picture element value for each block with the determination threshold 
T, determines a block whose variation in image or picture element value is equal to or larger than the determination 
threshold T to be a valid block and a block whose variation in image or picture element value is smaller than the deter- 
mination threshold T to be an invalid block, and rewrites the variation in image or picture element value stored in the 

55 block information storing unit 4022 for each block to a binary block information fl " for a valid block and "0" for an invalid 
block) indicating that each block is valid or invalid. 

[0534] As described above, If the block information about all blocks in the present frame is stored in the block infor- 
mation storing unit 4022, the encoding 1060 sequentially reads in a predetermined order from the block information 
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storing unit 4022 the block information about each block in the present frame, and encodes only the data in the blocks 
whose block information refers to a valid block in all blocks in the present frame. 

[0535] Thus, according to the 4th embodiment, a histogram of the variation in a predetermined image or picture ele- 
ment value (for example, the maximum absolute value of difference) between corresponding blocks in the present frame 

5 and the reference frame is generated for one frame, and a determination threshold T is set as a reference value for use 
in extracting a valid block in the present frame according to the generated histogram. Therefore, an appropriate deter- 
mination threshold T can be set for each frame even if a frame contains a series of mottle images having different var- 
iations. Thus, the image data can be encoded after extracting the optimum valid block in each frame. 
[0536] Based on the frequency (the number of blocks) of each value in the variation in a image or picture element 

10 value, a determination threshold T can be set such that the number of valid blocks can be fixed for each frame. There- 
fore, the amount of codes can be controlled to be fixed for each frame, and the optimum image transmission can be 
realized under various conditions such as the information transmission speed of a transmission line, the number of 
pieces of frames per unit time. etc. 

[0537] Since the frequency of changes in images is leveled among frames in moving images, a determination thresh- 
15 old T is set only for the first n frames (n=1 . 2. 3, ...) and a determination threshold T set for the n-th frame can be used 
in detecting valid blocks in the (n+1)th and the following frames. Thus, an encoding process can be performed at a high 
speed for the (n+1 )th frame. 

[0538] Furthermore, a valid block can be extracted at a high speed by using the maximum absolute value of difference 
as the variation in a image or picture element value, thereby performing the encoding process at a high speed. The sum 
20 of absolute values of differences or the sum of square numbers of differences can be used as the variation in the image 
or picture element value. 

[0539] As described above, when moving images are encoded, an absolute value of the difference is obtained for 
each image or picture element in each block in the reference frame, the maximum absolute value of differences is com- 
pared with a predetermined threshold, and it is determined whether or not each block in the reference frame is valid or 
25 invalid. At this time, if a image or picture element signal contains any noises, then an area that should be normally level 
indicates an unleveled color in a block form. 

[0540] That is. in a series of blocks in an area where similar colors are used adjacently (for example, a background 
area), if a block is determined to be valid and another block adjacent to that block is considered to be invalid due to 
noises, etc. generated in a image or picture element signal, then the above described problem arises. These block 
30 noises appear conspicuously as the encoding process is performed further. Accordingly, it is indispensable to periodi- 
cally refresh a reference frame to solve such a problem. 

[0541] However, if a refreshing process is performed in a conventional method, unnatural flashing images are dis- 
played because large differences are recorded between adjacent frames. 
[0542] Next, an embodiment for solving such problems is explained below. 

35 [0543] Figure 53 is the flowchart indicating the 10th image data encoding method according to the above described 
embodiment. The flowchart indicates a process of encoding image data in one frame. 
[0544] In this method, image data in the present frame are divided into n (n=1 . 2. 3. ...) areas (S151). 
[0545] According to the present embodiment, determination thresholds Th 1t Th 2 . Th 3 , .... Th n are individually provided 
for each of the divided areas, and a valid block is extracted by using a corresponding determination threshold for each 

40 block in each area. 

[0546] That is. the first area is selected from the above described n areas, and the areas are divided to a plurality of 
blocks of a predetermined size (for example. 8x8 image or picture elements or 16x16 image or picture elements, etc.). 
Then, the variation in a predetermined image or picture element value (the maximum absolute value of difference, the 
sum of absolute values of differences, or the sum of square numbers, etc.) between the corresponding blocks in the 
45 present and reference frames is obtained, and is compared with a corresponding determination threshold Th (1) so that 
it is determined whether or not the image data are different between the corresponding blocks in the present and refer- 
ence frames (S152 and S153). 

[0547] Then, a valid block, that is. a block determined to have changed in image data compared with the reference 
frame, is extracted ("Yes* in S153), and the image data in valid blocks are encoded (S154). On the other hand, image 
so data in an invalid block, that is, a block determined not to have changed in image data compared with the reference 
frame (S 1 53) are not encoded at all . 

[0548] When the above described processes in S152 through S154 have been performed on ail blocks in thef irst area 
selected first ("Yes" in S155). the processes in S152 through S155 are performed on the next selected second area. 
[0549] Thus, image data are encoded tor the valid blocks determined as described above in the second area. 
55 [0550] In all areas in the present frame, if the processes in steps S 1 52 through S 1 55 are performed, and the encoding 
process has been performed on all areas in the present frame ("Yes" in S1 56), then the process of encoding image data 
in the present frame is terminated. 

[0551] Thus, a difference generated in an area (difference between a reconstructed image and the original image) 



39 



EP0 899 959 A2 



can be reduced by using a determination threshold individually for each area in a frame or by setting a small determi- 
nation threshold for an area. That is. if a difference can be detected, the corresponding block is extracted as a valid 
block, and an encoding process is performed on the valid block. Thus, the deterioration of images due to a cBfference 
in a specific area can be prevented by adjusting a determination threshold or by reducing the difference in a specific 

5 area to a level beyond the visual recognition. 

[0552] Furthermore, the increment in the amount of codes detected in a reference frame refreshing process can be 
minimized. That is, a block is extracted or encoded only if it has changed in images to the extent that the difference can 
be recognized (a valid block). Therefore, the amount of data to be encoded can be reduced and the total amount of 
codes can be lessened. In this case, a refreshing operation can be performed without any problem by reducing the 

w determination threshold of each area down to a value small enough to extract as a valid block only a block whose dif- 
ference in image data generates the deterioration in a resultant image. 

[0553] Figure54 is the flowchart indicating the 1 1th image data encoding method as another embodiment of solving 
a problem in the above described conventional refreshing process. 

[0554] The flowchart in Figure 54 indicates a method of encoding a plurality of frames. The process in step S162 
is shown in Figure 54 is equivalent to the processes in steps S151 through S156 in the flowchart shown in Figure 53. 
[0555] In the encoding method, a determination threshold individually used in each area in a frame is appropriately 
modified (S1 61). 

[0556] Using a modified determination threshold, the image data in the present frame can be encoded according to 
the flowchart shown in Figure 53 (S1 62). 
20 [0557] Back in step S1 61 , a determination threshold to be assigned to each area in the succeeding frame is modified, 
and the image data in the frame are encoded (S1 62). 

[0558] Likewise, the processes in steps S1 61 and S1 62 are performed on the remaining frames. If the encoding proc- 
ess has been performed on ail frames ("Yes" in 163), the encoding process is terminated. 

[0559] Thus, a conventional problem that unnatural flashing images are generated can be prevented by sequentially 
25 encoding a series of frames. 

[0560] An example of the solution is explained as follows. 

[0561] For example, a frame is divided to 10 areas, and the 10 areas are individually named the 1st area, the 2nd 
area, and the 10th area. The determination thresholds for each of the areas are Th, (for the 1st area). Tt^ (for the 

2nd area) and Th 1 0 (for the 1 0th area). 

30 [0562] Furthermore, two additional thresholds VAL^ and VAL^ are provided as determination thresholds. 

[0563] VALg: a threshold for use in a refreshing process to determine as an invalid block a block whose difference in 
images is small enough to generate deterioration of images that can be recognized. 
[0564] VAL^: a threshold larger than VALq, and used to reduce the amount of codes. 

[0565] When a threshold is modified at frame intervals, the threshold to be assigned to each of the areas in the 1 st to 
35 the 1 0th frames is modified as follows. 
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Th ? = Thg = Th g - Th 1Q ( Th x = VAL a , 
Th 1Q = VAL b ) 

the 2nd frame < Th^ = Th 3 = 
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= . . . , Thg = VAL b ) 
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[0566] TTiat is, in the 1st frame, threshold VALa is assigned only to determination threshold Th 1 in the 1st area, while 
threshold VAL b is assigned to determination thresholds Th2 through Th 10 . Thus, in the 1st frame, the difference in the 
1st area in the 1st frame is reduced down to the extent that the deterioration of image cannot be recognized. 

5 [0567] In the 2nd frame, since threshold VALq is assigned only to the 2nd area, the difference in the 2nd area in the 
reference frame is reduced down to the extent that the deterioration of image cannot be recognized. 
[0568] Likewise, in each frame from the 3rd to the 10th frames, the image data in the reference frame are refreshed 
in the 10th frame by sequentially assigning threshold VAL^ to the 3rd, the 4th, .... and the 10th area respectively. Then, 
the image data in the reference frame can be refreshed every 10th frame by repeating the above described process on 

10 the 1 1th and the following frames. 

[0569] If the image data in the reference frame are refreshed by this method, one area is refreshed for each frame. 
Accordingly, unnatural flashing images generated in a refreshing process are prevented by setting the areas to an 
appropriate size, thereby solving the problem caused by the conventional method. 

[0570] Next another method of solving the problem caused by the conventional method is described below. 
75 [0571 ] In this case, ten thresholds having, for example, the following correlation are preliminarily provided. 
VAL, < VALs < VAL 3 < VAL4 < VAL 5 < VAL* < VAL 7 < VAL* < VALg < VAL 10 
[0572] Assume that VAL, corresponds to VAL^ above. 

[0573] The determination threshold assigned to each area in the 1 st through the 10 frames is modified in a loop format 
as follows. 

20 

the 1st frame Th^ < Th 2 < Th 3 < Th 4 < Th 5 < Thg < 

Th ? < Th Q < Th g < Th 1Q (Th ± = VAL ± ( i = 1 ~ 10 ) 

the 2nd frame Th 2 < Th 3 < Th 4 < Th 5 < Thg < Th 7 < 

Thg < Th 9 < Th 1Q < Th l ( Th i e VAL i-l <i ■ 2 f 3 # 
30 9), Th t = VAL 1Q ) 
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the 10th frame Th 10 < Th x < Th 2 < Th 3 < Th 4 < Th 5 
< Th 6 < Th 7 < Thg < Thg (Th 10 = VAL X Thj = VALj^ (j = 
1 " 9) 



[0574] In this method, the difference in each area in the reference frame can be reduced more gradually than the 
method described above. Therefore, unnatural flashing images can be furthermore prevented. 
[0575] In the above described two examples, the correspondence between an area and a determination threshold is 
45 modified for each frame. However, it can be modified optionally for any intervals. Furthermore, it can be modified for any 
time intervals, not frame intervals. The necessary process is indicated as the process in step S161 indicated by the 
flowchart shown in Figure 54. 

[0576] Figure 55 is the flowchart indicating the 12th image data encoding method according to another embodiment 

for solving the problem caused in the refreshing process by the conventional method. 
so [0577] According to the encoding method indicated by the flowchart, the determination threshold used for each area 

in a frame can be modified by an arithmetic operation, not by a switch of outputs (S1 71). This process is equivalent to 

the process in step $161 of the flowchart shown in Figure 54. A determination threshold is modified for each area. 

[0578] While a determination threshold for each area is modified at predetermined frame intervals or time intervals, 

the image data in each frame are encoded as in the process in step S162 indicated by the flowchart shown in Figure 
55 54 (S1 71 through S1 73). 

[0579] Therefore, this encoding method provides an effect equivalent to that of the 1 1th image data encoding method 

indicated by the flowchart shown in Figure 54. 

[0580] Figure 56 is the block diagram indicating the configuration of the 24th image data encoding device for encoding 
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a series of image data in frame units according to the encoding method indicated by the flowchart shown in Figures 56. 
53, 54, and 55. 

[0581 ] A reference frame storing unit 5030 is a memory for storing image data in the reference frame for use in detect- 
ing a valid block in the reference frame applied through a terminal 5010. 
5 [0582] An area dividing unit 5040 divides image data in the present frame applied through the terminal 501 0 into a 
plurality of areas Then, it sequentially outputs starting with the 1st area to a block change determining unit 5060, and 
outputs to a determination threshold output unit 5050 an identification signal (area identification signal) Rid indicating 
the area being outputted to the block change determining unit 5060. 

[0583] In addition to the area identification signal Rid, the determination threshold output unit 5050 receives a frame 
10 signal FR n indicating the frame number of the present frame from a terminal 5020. and outputs to the block change 
determining unit 5060 according to these signals the determination threshold for use in detecting a valid block in each 
block in the areas in the present frame whose image data have been inputted to the block change determining unit 
5060 

[0584] The block change determining unit 5060 divides the image data in each area applied by the area dividing unit 
75 5040 to a plurality of blocks, compares the image data in each block with the image data in the corresponding block in 
the reference frame stored in the reference frame storing unit 5030. and obtains the variation in a predetermined image 
or picture element value. Then, the unit compares the variation in a image or picture element value with the determina- 
tion threshold applied from the determination threshold output unit 5050, determines whether the present block is valid 
or invalid, and outputs the determination result to the reference frame storing unit 5030, a block information output unit 
20 5070, and an encoding unit 5080. 

[0585] The block information output unit 5070 receives a determination result and externally outputs it through a ter- 
minal 5090 as block information (T for a valid block, and m Q" for an invalid block). 

[0586] On receiving a determination result indicating that the present block is valid, the encoding unit 5080 receives 
the image data of the block from the area dividing unit 5040, and encodes them, ft does not encodes the image data of 
25 invalid blocks. The unit externally outputs through a terminal 5100 the encoded data of valid blocks obtained by the 
encoding process. 

[0587] The reference frame storing unit 5030 receives the determination result as a reference frame update signal 
REf (for example, "High" for a valid block, and "Low" for an invalid block), and replaces the corresponding block in the 
reference frame stored therein with the block stored in the area dividing unit 5040 if the block is valid. If the block is 

30 invalid, the corresponding block in the reference frame is not replaced at all. 

[0588] Thus, it is determined whether or not each block in each divided area of image data in the present frame 
applied from the terminal 5010 is valid according to an individual determination threshold outputted by the determina- 
tion threshold output unit 5050. Then, the encoding unit 5080 encodes only valid blocks, and the reference frame stor- 
ing unit 5020 replaces the image data in the corresponding block in the reference frame with the image data in the valid 

as block. 

[0589] Therefore, a series of image data can be appropriately encoded by the image data encoding method indicated 
by the flowchart shown in Figure 54 or 55. 

[0590] Next, each of the configuration examples of the determination threshold output unit 5050 is shown in Figures 
57A, 57B, and 57C. 

40 [0591 ] Figure 57A shows an example of a basic circuit for outputting determination threshold Th n (n = 1 , 2, . . .) set for 
each area in a frame. That is, a threshold storing memory 5051 stores determination threshold Trv, (n = 1 , 2, ...) indi- 
vidually corresponding to each area in a frame. 

[0592] On receiving an area identification signal Rid from the area dividing unit 5040 shown in Figure 56. an address 
sending unit 5052 sends an address in the threshold storing memory 5051 in which determination threshold Th n corre- 
45 sponding to the area indicated by the signal Rid is stored. Thus, the threshold storing memory 5051 outputs determi- 
nation threshold Th n corresponding to the area being received by the encoding area. That is, no frame signals FR n are 
used in the circuit. 

[0593] Next, Figure 57 shows a circuit example of switching determination threshold Th n for each area in each frame. 
It relates to the image data encoding method indicated by the flowchart shown in Figure 25. In Figure 57, a threshold 

50 storing memory 5053 has a configuration similar to that of the threshold storing memory 5051 . 

[0594] In Figure 57B, an address transforming unit 5053 generates an address in the threshold storing memory 5052 
according to an area identification signal Rid received from the area dividing unit 5040 and to a frame signal FR n 
received through the terminal 5020, and outputs the address to the memory 5053 for storing determination threshold 
Th n for the area in the present frame outputted from the area dividing unit 5040 to the block change determining unit 

55 5060. Then, the threshold storing memory 5053 outputs determination threshold Th n for the area in the present frame 
to the block change detecting unit 5060. 

[0595] Thus, in this circuit determination threshold Th n is set according to a frame signal indicating a frame number 
and to an area identification signal Rid indicating the area for which a valid/in-valid block determination is made. There- 
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fore, determination threshold Th n for each area in a frame can be modified (switched) at a predetermined frame inter- 
vals (for each of any number of frames) as in the image encoding method indicated by the flowchart shown in Figure 55. 
[0596] Then, the circuit shown in Figure 57C has the function equivalent to that of the circuit shown in Figure 57B. 
With this circuit, a threshold storing memory 5056 shown in Figure 57C has the same configuration as the threshold 

5 storing memory 5053 shown in Figure B. 

[0597] On receiving an area identification signal Rid from the area dividing unit 5040, an address generating unit 5057 
notifies of an address to be outputted the threshold storing memory 5056 storing determination threshold Th n for the 
area in the present frame being applied to the block change detecting unit 5020. Thus, the threshold storing memory 
5056 outputs to a threshold transforming unit 5058 determination threshold Th n for the area stored at the above 

io described address. 

[0598] The threshold transforming unit 5058 converts determination threshold 7h n to determination threshold Th n * for 
the area in the present frame indicated according to a frame signal FR n received from the terminal 50202. and outputs 
threshold Th n ' to the block change detecting unit 5020. 

[0599] Thus, with the circuit, the threshold transforming unit 5058 converts determination threshold Th n fixedly 
is assigned to each area in a frame and outputted by the threshold storing memory 5056 to determination threshold Th n ' 
and outputs it to the block change detecting unit 5060. Therefore, as in the image data encoding method indicated by 
_ the flowchart shown in Figure 55, modifying predetermined determination threshold Th n through an arithmetic opera- 
tion modifies the value of determination threshold Thn for each area in a frame for each of any number of frames. 
[0600] As described above, according to the present invention, a frame is divided into a plurality of block when a series 
20 of images such as moving images, etc. are encoded, and a block indicating a change in images from the preceding 
frame as indicating a value larger than a predetermined threshold is extracted as a valid block, and only the image data 
of the valid block are encoded. Therefore, moving having rather static images between adjacent frames such as TV tel- 
ephone images, moving images, etc. can be compressed efficiently. 

[0601 ] Furthermore, when an original image is reconstructed, block information indicating whether a block in a frame 

25 is valid or invalid is transmitted together with encoded data of image data in the valid block. Therefore, an image recon- 
structing equipment can recognize the position of the valid block according to the block information. As a result, the 
image reconstructing equipment can display the image in the valid block at a correct position when the original image 
is reconstructed from the encoded data in the valid block. That is. a series of images such as moving images, etc. can 
be reconstructed by modifying images in valid blocks. 

30 [0602] Furthermore, according to the present invention, two thresholds are used as determination thresholds for use 
in determining a valid block. The two thresholds are appropriately used so that image change starting and ending por- 
tions can be correctly detected and the image-changed areas can be extracted as a series of valid blocks in adjacent 
areas where images change from those in the preceding frames even if the variation in images is not constant or the 
areas include blocks where images change moderately. Thus, a natural image can be reconstructed successfully. 

35 [0603] Additionally, according to the present invention, image data are encoded after a frame is divided into valid and 
invalid blocks when a refreshing process is performed. Then, the encoded data are divisionally transmitted to a recon- 
structing equipment. Thus, a refresh frame receiving equipment can reconstruct an original image without being 
assigned lengthy wait time. Furthermore, the capacity of code buffers for storing encoded data can be reduced both in 
sending (encoding) and receiving (reconstructing) equipments. 

40 [0604] According to the present invention, image data in a reference frame (reference images) can be updated during 
a refreshing process at a higher speed than by a conventional method. 

[0605] Furthermore, according to the present invention, a determination threshold used in extracting a valid block 
(whose data are to be encoded) indicating a change in images from the reference frame can be adaptively set such that 
the amount of codes refers to an appropriate value under various conditions such as the transmission rate of images 

45 and a transmission line, the number of transmitted frames per unit time, etc. As a result, an image can be transmitted 
according to the above described conditions, and a higher quality image can be transmitted. 
[0606] According to the present invention, the variation in a predetermined image or picture element value between 
each block in a transmission frame and the corresponding block in the reference frame is obtained, the frequency (the 
number of blocks) of the variation in a predetermined image or picture element value is obtained in all transmission 

50 frames, and a determination threshold is set to extract a valid block (whose data are to be encoded) indicating a change 
in images from the reference frame according to the frequency. As a result, a determination threshold can be set such 
that the amount of codes refers to an appropriate value under various concfitions such as information transmission 
speed, the number of transmitted frames per unit time, etc. Thus, the optimum image transmission can be realized 
according to the above described conditions. 

55 [0607] Furthermore, according to the present invention, a threshold can be assigned individually to each area in each 
frame. Therefore, the value of a threshold is minimized for an area in the reference frame to be refreshed and updated 
so that the deterioration of the image in the updated area can be reduced and cannot be recognized in the recon- 
structed image. 
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[0608] Each of the areas in the reference frame can be sequentially refreshed at predetermined frame intervals by 
changing the above described update areas at predetermined frame intervals (for example, changing in block line units 
downwards from the top of an image). In this case, all blocks in the reference frame are not refreshed simultaneously, 
but each area in the reference frame is sequentially refreshed at predetermined frame intervals. As a result, the differ- 

5 ence in images between adjacent images before and after the refreshed areas, thereby constructing a natural image. 
[0609] Since all blocks in the reference frame are not refreshed simultaneously and unconditionally as in the conven- 
tional method, but only a block indicating the difference to the extent that the deterioration of an image can be recog- 
nized is refreshed, the increment of the amount of codes during the refreshing process can be minimized. 
[0610] While the invention has been shown and described with particular reference to the preferred embodiment 

10 thereof, it will be understood that variations and modifications in form and details may be made therein without depart- 
ing from the spirit and scope of the inventions as defined in the appended claims. 

Claims 

is 1. A method of coding data in units of block by dividing a frame into a plurality of blocks comprising: 

steps (S1 , S2) determining the existence of change of image data within a block of the present frame by com- 
paring an image element within the block of the present compared to the corresponding image element of the 
block in the same position in the reference frame; 
20 based on the result of the determination, step (S3) of outputting block information designating whether the 

block in the present frame is a valid block in which the image changes from the reference frame; 
and steps (S4, S5) of coding only the image data of the valid block. 

2. The image data coding method according to claim 1 wherein the result of the determination is kept until the image 
25 data of all the valid blocks in the present frame is coded and the held block information of all the blocks in the 

present frame is outputted together with the coded data of the valid blocks in the present frame. 

3. The image data coding method according to claim 1 wherein the number of the valid blocks which are continuous 
after the valid blocks is outputted as the block information succeeding the coded data of the valid blocks based on 

30 the result of the determination. 

4. The image data coding method according to claim 1 wherein the block information is coded and then outputted. 

5. The image data coding method according to claim 1 wherein the image data of the valid blocks are coded using an 
35 orthogonal transform. 

6. The image data coding method according to claim 1 wherein the determining steps (S1, S2) determine that the 
image changes from the reference frame when the amount of the changes of the value of the predetermined image 
element within a block of the present frame compared to the corresponding image element of the corresponding 

40 block in the same position in the reference frame is more than the predetermined threshold value. 

7. The image data coding method according to claim 6 wherein the amount of the change of the value of the prede- 
termine image element is provided by the maximum value of the absolute value of the difference between the value 
of the predetermined image element in the block in the present frame and the value in the corresponding image 

45 element in the corresponding block in the reference frame in the same position as in the present frame. 

8. The image data coding method according to claim 6 wherein the amount of the change in the value of the prede- 
termined image element is provided by the sum of the absolute value of the difference between the value of the 
predetermined image element within a block of the present frame and the value of the corresponding image ele- 

50 ment of the corresponding block in the same position in the reference frame with regard to all the image element in 
respective blocks in the present frame. 

9. The image coding method according to claim 6 wherein the amount of the change of the predetermined value of 
the image element is provided by the sum of the second power value of the difference between the predetermined 

55 value of the image element within a block of the present frame and the value of the corresponding image element 
of the corresponding block in the same position in the reference frame. 

1 0. An image data coding apparatus for coding image data in units of block by dividing a frame into a plurality of blocks 
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comprising: 

a reference frame holding means (612) for holding the image data of the reference frame; 
a current frame holding means (610) for holding the image data of the present frame; 
a determining threshold value holding means (618a) for holding a threshold. value to determine whether the 
image within a block of the present frame changes the corresponding image data of the block in the same posi- 
tion in the reference frame; 

change amount calculating means (61 4) for obtaining the amount of change of the predetermined value of the 
image element within a block of the present frame compared to the corresponding image of the block in the 
same position in the reference frame; 

block change determining means (616) for determining the change of the image between the image within a 
block of the present frame and the corresponding image of the block in the same position in the reference 
frame; 

selecting means (618) for selecting only the image data of the valid block in which the image changes from the 
reference frame by said block change determining means (616), among the image data in respective blocks in 
the present frame held in the holding means (610); 

coding means (622, 624, 624a, 626, 626a) fa coding the image data of the valid block inputted from the select- 
ing means (618); 

coding means (622, 624, 624a t 626, 626a) for encoding the image data of said valid block inputted from the 
coding means (618); and 

outputting means (630) for outputting the result of the determination of the block change determining means 
(616) together with the coded data of the valid block generated from the coding means (622, 624, 624a, 626. 
626a). 

11. The image data coding apparatus according to claim 10 wherein the coding means (622, 624, 624a, 626, 626a) 
encodes the image data of the valid block by using an orthogonal transform. 

12. The image data coding apparatus according to claim 10 further comprising: 

block information holding means (620) for holding the result of the determination by the block change determin- 
ing means (616) with regard to all the blocks of the present frame; and 

coded data holding means (628) for holding the coded data of all the valid blocks in the present frame which 
are generated by the coding means (622, 624, 624a, 626. 626a); and 

wherein said outputting means (630) outputs the result of the determination of all the blocks in the present 
frame held in the block information holding means (620) and coded data of all the valid blocks in the present 
frame held in the coded data holding means in a switching manner. 

1 3. The image data coding apparatus according to claim 1 0 further comprising; 

calculating means (670) for calculating the number of the continuous invalid blocks whose images are deter- 
mined as non-changing from the image in the reference frame by using said block change determining means 
(616) and 

wherein the outputting means (630) outputs as the block information the number of continuous invalid blocks 
succeeding the valid block calculated by calculating means (670) after the coded data of the valid blocks is out- 
putted. 

14. The image data coding apparatus according to claim 10 further comprising: 

block information holding means (620) for holding the result of the determination by block change determining 
means (616) with regard to the blocks of the present frame; 

block information coding means (690) for coding the result of the determination of the block of the present 
frame held in the block information holding means (620) and for outputting it as block information; 
coded data holding means (628) for coding the coded data of the valid blocks of the present frame generated 
by the coding means (612, 624) and wherein said outputting means (630) outputs the block information gener- 
ated by the coded data of the valid blocks of the present frame held in the coded data holding means (628). 

15. The image data coding apparatus according to claim 10 wherein 
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said amount-of-change calculating means (614) obtains the absolute value of the difference of the value of the 
predetermined image element within a block of the present frame compared to the corresponding image ele- 
ment of the block in the same position in the reference frame and provides the maximum value of the absolute 
value of the difference in respective blocks of the present frame as the amount of the change of the value of 
s the predetermined image element. 

16. The imaged data apparatus according to claim 10 wherein 

said amount-of-change calculating means (614) obtains the absolute values of the difference between the val- 
10 ues of the predetermined image element within a block of the present frame compared to the corresponding 

image element of the block in the same position in the reference frame and provides the sum of the absolute 
value of the difference in respective blocks of the present frame as the amount of changes of the value of the 
predetermined imageelement: 

is 1 7. The image data coding apparatus according to claim 1 0 

said amount-of-change calculating means (614) obtains the difference in the image element within a block of 
the present frame compared to the corresponding image element of the block in the same position in the ref- 
erence frame and provides the sum of the squares of the differences in the respective blocks in the present 
20 frame as an amount of the change in the value of the image element in respective blocks in the present frame. 

18. A method of decoding image data comprising:- 
a step (S12) of decoding image data of a valid block from coded data; 

a step (S14, S15) of updating an address of an image memory into which the image data of the valid block is 
written, based on a content of a block information; 

and a step (S13) of writing the decoded image data of the valid block intd the image memory in accordance 
with the updated address; 
wherein the method further comprises: 

a step of decoding the coded data of the block information into the original information; 
a step (S1 1 , S1 2) of decoding the valid image data of the valid block from the coded data of the image data of 
the valid block; 

a step (S14, S15) of updating an write address of a image memory for the image data of the valid block based 
on the content of the decoded block information and 

a step (S13) of writing the decoded image data of the valid block into the image memory in accordance with 
the updated address. 

19. An image data decoding apparatus for decoding the code data and block information of the image data of the valid 
block generated by said image data coding apparatus according to claim 10. further comprising; 

40 

an image memory (658) for storing the decoded image data; 

decoding means (646. 648, 650) for decoding the image data of the valid block from the decoded data and 
address calculating means (654. 656) for calculating the write address of the image memory (658) for the 
image data of the valid block decoded by the decoding means (646, 648. 650) from the block information. 

45 

20. The image data decoding apparatus according to claim 1 9 wherein said address calculating means (654, 656) cal- 
culates the number of continuous invalid blocks from the block information and obtains the write address of the 
decoded image data. 

so 21 . The image data decoding apparatus according to claim 1 9 further comprising; 

separating means (640) for separating the coded data and the block information of the image data from the 
received input data. 

55 22. An image data decoding apparatus for decoding the coded data of the image data of the valid block generated by 
the image data coding apparatus according to claim 10, further comprising: 

image memory (658) for storing the decoded image data; 
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decoding means (646, 646. 650) for decoding the image data of the valid block from the decoded data; and 
address calculating means (682. 656) for calculating the write address of the image memory (558) for the 
image data decoded by the decoding means (648). 

23. The image data decoding apparatus according to claim 22 wherein said address calculating means (652, 656) 
obtains the write address of the decoded image data based on the number of the continuous invalid blocks of the 
block information. 

24. The image data coding apparatus according to claim 22 further comprising; 

separating means (640) for separating the coded data and block information of the image data from the 
received input data. 

25. A method of encoding the continuous image comprising a step of encoding a refresh frame and 

a step of dividing said encoding step into a plurality of sub steps. 

26. A method of encoding method comprising: 

a first step (S1 01) for determining an existence of change of the image within a block of the present frame com- 
pared to the corresponding image of the block in the same position in the reference frame; 
a second step (S103) for encoding only the valid block of the present frame which is determined as having a 
change from the image of the reference frame in the first step (S1 01 ) when the present frame is not the refresh 
frame and; 

a third step (S107, S108. S109) of encoding the valid block of the reference frame and for encoding the invalid 
block of the present frame which is added as not having a change from the reference frame in the first step 
(S101) after the completion of the decoding of the valid block, when the present frame is a refresh frame. 

27. An image data encoding apparatus for encoding continuous image data comprising: 

a reference frame holding means (11) for holding the image data of the reference frame; 
present frame holding means (1 2) for holding the image data of the present frame; 

determining threshold value holding means (13) for holding the threshold value which is to be used for deter- 
mining the existence of the change of the image within a block of the present frame compared to the corre- 
sponding image of the block in the same position in the reference frame; 

block change determining means (14) for obtaining an amount of the change of the value of the predetermined 
image within a block of the present frame compared to the corresponding image of the block in the same posi- 
tion in the reference frame held in the reference frame holding means (11) and for determining the change of 
the image within a block of the present frame compared to the corresponding image of the block in the same 
position in the reference frame; 

block information holding means (1 5) for holding the result of the determination with regard to respective blocks 
of the present frame obtained by the block change determining means (14) as the block information; 
coding means (16) for. based on said block information, coding only the valid block of the present frame which 
is determined as having the change from the corresponding blocks in the reference frame is not the refresh 
frame and all the blocks of the present frame by dividing them into blocks and the inputting blocks which are 
determined not having the change from the image in the reference frame when the present frame is the refresh 
frame; 

wherein said reference frame holding means (1 1) updates the image data within a block of the present frame 
compared to the corresponding image of the block in the same position in the reference frame. 

28. The image data coding apparatus according to claim 27. further comprising; 

a refresh signal generating means (1 9) for outputting a refresh signal designating that the present frame is the 
refresh frame, to the encoding means (16) and the reference frame holding means (11) when the number of 
frames encoded by the encoding means (1 6) reaches the predetermined value. 

29. A method of encoding image continuous data comprising: 
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a first step (S101 ) for determining whether blocks of the present frame changes from the corresponding one by 
comparing the image data in respective blocks in the present frame with the corresponding image data in 
respective data in the reference frame at the same position as the corresponding one; 
a second step (S103) of encoding only the valid block of the present frame which is determined as having the 
change in the image from that of the reference frame according to the first step (S101) when the present frame 
is not a refresh frame; 

a third step (S103, S107, S108, S109, S1 10) of encoding the invalid blocks which is determined as not having 
the change from the reference frame in accordance with the first step (S101) after the completion of encoding 
of the valid block when the present frame is the refresh frame; 

a fourth step (S1 07, S1 2 1 ) of updating the block in the reference frame which corresponds to the encoded valid 
blocks of the encoded present frame, to the encoded valid blocks of the encoded present frame after the com- 
pletion of the second step (S103); and 

step (S122) fa switching image data of the present frame into the image data of the reference frame after the 
completion of the third step (S103. $107. S108. S109, $1 10). 

30. The image data encoding apparatus for encoding continuous image data comprising: 

a reference frame holding means (21) for holding image data of the reference frame; 

the present frame holding means (22) for holding the image data of the present frame; 

determining threshold value holding means (23) for holding a threshold value to be used for determining the 

existence of the change of the image within a block of the present frame compared to the corresponding image 

of the Woe* in me same position in the reference frame; 

block determining means (24) for obtaining an amount of the changes of the value of the predetermined image 
element in respective blocks in the present frame held in the present frame holding means (22) from the cor- 
responding one held in the reference frame holding means (21) at the same position as the corresponding one 
in the present frame and determines whether image in respective blocks in the present frame changes from 
that in the reference frame by comparing said amount of changes with a threshold value held in the determi- 
nation threshold value holding means (23); 

block information holding means (25) for holding the result of the determination of all the blocks of the present 
frame designated by the block change determining means (24) as block information; 
encoding means (26) for, based on the block information of respective blocks of the present frame held in the 
block information holding means (25), encoding only the valid block of the present frame which is determined 
as having the change from the corresponding one in the reference frame when the present frame is not a 
refresh frame and for coding ail the blocks of the present frames when the present frame is the refresh frame; 
a frame changing means (27) for changing the reference frame holding means (21) to the present frame hold- 
ing means (22) and for changing the present frame holding means (22) to the reference frame holding frame 
(21) where the present frame coded by the holding means (26) is a refresh frame and 
wherein said reference frame holding means (21) updates the image data of the block in the reference frame 
at the same position as the encoded valid block of the present frame to the image data of the valid frame block 
in the encoded present frame when the encoded present frame is not a refresh frame. 

31 . A method of encoding the image data comprising: 

a first step (S131) of determining one of changes of the value of the predetermined image element in respec- 
tive blocks of the present frame from the corresponding one in the reference frame in the same position as that 
of the present frame; 

comparing (S131) the amount of changes with the predetermined threshold value and 
determining (S131) the existence of the change of the image in respective blocks into frame from the corre- 
sponding one of the reference frame in the same position as that of the present frame; 
a second step (S131) for coding only the valid block of the present frame which is determined as having the 
change from the corresponding one of the reference frame in accordance with the first step (S131); and 
a third step (S138) for changing the threshold value used in the comparing step (S131) in accordance with the 
change of the image between the reference frame and the present frame based on the result in the comparing 
step(S131). 

32. A method of encoding the image data comprising: 

a first step (S131) for determining in the amount of changes the predetermined value of the image element in 
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respective blocks of the present frame from the corresponding one in the block in the reference frame at the 
same position, comparing the amount of changes with determined threshold value and determining the exist- 
ence of the variation of the images in respective blocks in the present frame from corresponding one in the ref- 
erence frame at the same position; 

a second step (S132) of encoding only the valid blocks of the present frame which are determined as having 
the change in the image from the reference frame in accordance with the first step (S131); 
a third step (S132, S133) of determining whether the threshold value used in the first step (S131) is appropri- 
ate, based on a coding amount obtained by the second step (S132) and changing the threshold value to 
another value when the value is determined as being an inappropriate value and 

wherein said first and second steps (S131 , S132) and the third step (S137) determine that the threshold value 
is appropriate. 

33. A method of encoding the image data according to the claim 32 wherein 

said third means (S1 32-S1 35) is applied to a first frame or any frame and 

the first means (S101) uses the threshold values determined any preceding frame in the third means S132- 
S135) which is performed precedingly. 

34. A method of encoding continuous image data comprising: 

a first means (1030, 3020, 3026, 3028) of obtaining an amount of changes of the predetermined value of the 
image element and respective blocks of the present frame from the corresponding one in the reference frame 
in the same position as that in the present frame, comparing the amount of the changes with a predetermined 
threshold value, and of determining the existence of changes of the image in respective blocks in the present 
frame; and 

a second means (3022) of determining whether the threshold value in the first means (3020) is appropriate or 
not based on the number of the valid blocks of the present frame which is determined as having the existence 
of the image from the reference frame which is determined as having change in the image from that in the ref- 
erence frame in accordance with the first means (1030) or the number of invalid blocks of the present frame 
which is determined as not having change in the image from the reference frame and changing the said thresh- 
old value to other value when threshold value is not appropriate; 

a third means (3029), for encoding the blocks in the present frame which is determined as being the valid 
blocks in accordance with a first means (1033) when the threshold value is determined as appropriate value in 
accordance with the second means (3022) and 

wherein the first means (1033) is performed when the new threshold value is determined in accordance with 
the second means (3022). 

35. A method of decoding the image data according to claim 33 wherein; 

said second means (3022) is applied to only a first frame or any frame and the threshold value determined for 
the preceding frame in the second means (3022) in the preceding stages is used in the first means (1030) 
when the succeeding frame is encoded. 

36. An image data encoding apparatus for encoding continuous image data comprising: 

reference frame holding means (31) for holding the image data of a reference frame; 
present frame holding means (32) for holding image data of the present frame; 

determining threshold value holding means (33) for holding the threshold value to be used for determining the 
existence of change in the image within Hs respective block of the present frame from the corresponding image 
in the block in the same position as that of the present frame; 

block change determining means (34) for obtaining the amount of change with result to the value of the prede- 
termined image element in the respective block in the image of the present frame held in the present frame 
holding means (32) at the same position as that of the corresponding image held in the reference frame holding 
means (31); 

encoding means (35) for encoding only a valid block which is determined as having a change in the image in 
the block in the present frame corresponding one in the reference frame by said block change determining 
means (34); 

determining threshold value changing means (36) for determining whether the threshold value held in the 
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determining threshold value holding means (33) is appropriate, based on the amount of coded data produced 
by the encoding means (35). and for setting the value different from the said threshold value in the determining 
threshold value holding means (33) when the threshold value is riot appropriate; and 
encoding data outputting means (37) for outputting the coded data encoded by the encoding means (35). when 
the threshold value held in the determining threshold value holding means (33) is determined as appropriate 
by the determining threshold value changing means (36). 

37. An image data coding apparatus for coding continuous image data comprising: 

reference frame holding means (41) for holding the image data of the reference frame; 

the present frame holding means (42) for holding the image data of the present frame; 

determining threshold value holding means (43) for holding the threshold value to be used to determine the 

existence of change in the image in the respective block in the present frame from the corresponding image in 

the Hock at the same position in thVreference frame; 

block change determining means (44) for obtaining the amount of change in the value of the predetermined 
image element in the respective block of the image data of the present frame held in the present frame holding 
means (42) corresponding to the image element in the reference frame held in the reference frame holding 
means (41) at the same position as the corresponding one in the present frame and determining the existence 
of change in the image in respective block of the present frame from the corresponding image in the block at 
the same position as the corresponding one in the present frame by comparing the amount of the change with 
the threshold value held in the determining threshold value holding means (43); 

determining threshold value changing means (45) tor calculating or the number of valid blocks of the present 
frame which are determined as having the change in the image from the reference frame, the numbers of 
invalid blocks in the present frame which is determined as not having changed the image in the reference 
frame, by means of the block change determining means (44), determining whether the threshold value held 
in the determining threshold value holding means (43) is appropriate, based on the number of valid blocks or 
invalid blocks and for setting a value difference for the threshold value in the determining threshold value hold- 
ing means (43) when the threshold value is not appropriate, and; 

encoding means (46) for encoding only the block of the present frame held in the present frame holding means 
(42), which is determined as the valid block by the block change determining means (44) when the threshold 
value held in the determining threshold value holding means (43) is determined to be appropriate by the deter- 
mining threshold value changing means (45). 

38. A method of encoding the continuous image data comprising: 

a first step (S141, SI 42) of obtaining the amount of the change in the value of the predetermined image ele- 
ment which forms a reference value to be used to determine the existence of change in the image in the 
respective block of the present frame at the same position compared to the corresponding image element in 
the block in the reference frame at the same position, based on the image data of the present frame and the 
image data of the reference frame and preparing a histogram of the present frame as a whole, with regard to 
the amount of the changes in the values of the predetermined image element; 

a second step (S143) of providing determining threshold value to be used for determining the existence of 
change in the image element in the respective block in the present frame from the corresponding image ele- 
ment in the reference frame at the same position as the corresponding one in the present frame, based on the 
histogram obtained through the first step (S141 , S142); 

a third step (S144) for obtaining the amount of change in the value of the predetermined image element in the 
respective block of the present frame from that in the reference frame at the same position as the correspond- 
ing one in the present frame and detecting the existence of the variation of the image from the reference frame, 
with regard to the blocks of the present frame; and 

a fourth step (S145) for encoding only the image data of the valid block which is determined as having changed 
the image in the respective blocks of the present frame from the corresponding image in the reference frame 
in accordance with the third step. 

39. An image data encoding apparatus for encoding continuous image data comprising: 

reference frame holding means (51) for holding the image data of the reference frame; 
the present frame holding means (52) for holding the image data of the present frame; 
a histogram preparing means (53), for obtaining the amount of change in the value of the predetermined image 
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element which forms the reference values to be used, to detect the existence of change in the image in the 
respective block in the present frame from the corresponding image element in the block in the reference frame 
at the same position, based on the image data of the reference frame held in the reference frame holding 
means (51) and the image data of the present frame held in the present frame holding means (52) and prepar- 
5 ing a histogram of the present frame as a whole* with regard to the amount of the change of the present frame; 

determining threshold value setting means (54) for determining the threshold value to be used to determine the 
existence of change in the image in the respective blocks of the present frame from the corresponding one in 
the reference frame at the same position, based on the histogram prepared by the histogram preparing means 
(53); 

10 block change determining means (55) for comparing the amount of change in the value of the predetermined 

image element in the respective blocks of the present frame, obtained by the histogram preparing means (53) 
with the determining threshold value provided by the determining threshold value providing means (54) and for 
determining the existence of change in the image of the.respective blocks in the present frame from the blocks 
in the reference frame at the same position as the corresponding image of the present frame: and 

is encoding means (56) for encoding only the valid block, to be determined as having changed the image by the 

block change determining means (55) which are selected from all the blocks of the present frame. 

40. The image data encoding apparatus according to daim 39, wherein said histogram preparing means (53) obtains 
the absolute value of the difference between the value of the predetermined image element in respective blocks in 
20 the present frame and that of the image element in the blocks in the reference frame at the same position as the 
corresponding one in the present frame, providing the maximum value of the absolute value of the difference in 
respective blocks of the present frame as the amount of change in the value of the predetermined image element 
and preparing a histogram with regard to the amount of change. 

25 41 . A method of encoding the continuous image data comprising: 

a first step (S1 51) for dividing the image data of the present frame into a plurality of regions; 
a second step (S152, S153) of obtaining the amount of change in the value of the predetermined image ele- 
ment with in the respective blocks of the respective regions of the present frame obtained by the first step 
30 (S151) from the image element in the reference frame at the same position as the corresponding one in the 

present frame and determining the existence of change of the image in the respective blocks of the present 
frame from that of the reference frame. 

42. A method of encoding continuous image data comprising: 

35 

a first step (S151) for dividing the image data of the present frame into a plurality of regions; 
a second step (S152, S153) for obtaining the amount of change in the value of the predetermined image ele- 
ment in respective blocks of the respective regions of the present frame obtained by the first step (S151) from 
the corresponding image in the block in the reference frame at the same position, comparing the amount of 

40 change with the threshold value corresponding to respective regions which is selected from a plurality of 

threshold values and detecting the existence of change in the image in the respective blocks of the present 
frame from, that in the reference frame at the same position as the corresponding image in the present frame; 
a third step (S154) for encoding only the valid block of the present frames are determined as being changed 
from that of the reference frame in accordance with second step (S152, S153); and 

45 a fourth step for replacing the block in the reference frame at the same position as the valid block encoded 

through the third step (S154) by the valid block. 

43. A method of encoding image data according to claim 42, wherein said second step (S152, S153) comprises a step 
(161) for changing the relation between the plurality of regions of the present frame and the plurality of threshold 

so values assigned to the respective regions at a predetermined frame interval. 

44. A method for encoding image data according to claim 42, wherein the threshold value assigned to the respective 
regions of the present frame in the second step (S152, S153) is changed in a predetermined frame interval. 

55 45. The image data encoding apparatus for encoding the continuous image data comprising: 

a reference frame holding means (61) for holding the image data of the reference frame; 

a region dividing means (62) for dividing the image data of the present frame into a plurality of regions; 
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a determining threshold value outputting means (63) for outputting the threshold value to be used to detect the 
existence of change in the image in the respective block in the present frame from the corresponding image in 
the reference frame in respective area at the same position as that in the present frame obtained by region 
dividing m:^ns (62) with regard to the respective regions of the present frame; 

5 the block change determining means (64) for obtaining the amount of change in the value of the predetermined 

value in the block of the present frame from those element in the block in the reference frame held in the refer- 
ence frame holding means (61), with regard to the respective blocks in the respective regions of the present 
frame obtained by the region dividing means (62), comparing the amount of change with the threshold value 
inputted from the determining threshold value outputting means (63) and for determining the existence of 

10 change in the image in the respective blocks regarding the respective regions of the present frame from the 

corresponding image in the block in the reference frame at the same position; encoding means (65) for encod- 
ing only the valid block which is determined as having changed the image in the reference frame by means of 
block change determining means (64); 

block information outputting means (66). for outputting the result of the determination, by the block change 
is determining means (64) as the block information; and wherein; 

the reference frame holding means (61) replaces the block in the reference frame at the same position as the 
valid block in the reference frame by the valid block of the present frame, based on the result of the determina- 
tion by the block change determining means (64). 

20 46. The image data encoding apparatus according to claim 45, wherein said determining threshold value outputting 
means (63) comprises the threshold value holding means (63b) for holding a plurality of threshold values and con- 
trolling means (63a) for switching the threshold value outputted to the block change determining means (64) from 
the threshold value holding means (63a) in accordance with respective regions of the present frame with a prede- 
termined interval of respective frame. 

25 

47. The image data encoding device according to claim 45, wherein said determining threshold value outputting means 
(63) comprises the threshold value holing means (63d) for holding a plurality of threshold values corresponding to 
a plurality of regions of the present frame; and control means (63e) for outputting the threshold value corresponding 
to the respective regions of the present frame from said threshold value holding means (63b) and threshold value 

30 changing means (63f) for obtaining the threshold value outputted from said threshold value changing means (63d) 
in accordance with the respective regions of the present frame to output the changed threshold value to the block 
change determining means (64). 

48. A method of encoding image data in unit of block by dividing a frame into a plurality of blocks comprising: 

35 

steps (S21, S31. S36, S42, S52, S54, S59, S72, s76, S79, S80) for obtaining the amount of change of the 
value of the predetermined image element in the respective blocks of the present frame and from that of the 
block in the reference frame at the same position as that of the present frame, comparing the amount of change 
in the respective blocks in the present frame with the determining threshold value and determining whether the 
40 respective block in the present frame is a valid block in which the image changes from that in the reference 

frame; 

steps (S23. S25. S33. S35, S53. S73. S75. S77, S78) for changing the determining threshold value, in accord- 
ance with the result of determination; and 

steps (S24, S38, S40 ,S43, S56. S60) for decoding the imagedata in the block which is determined as the valid 
45 block in accordance with the above determining steps. 

49. The method of encoding the image data according to Claim 48 further comprises: 

the steps (S25, S33, S53) for changing the determining threshold value changes the determining threshold 
so value in accordance with the result of determination by the present block; and 

the determining steps (S21, S36, S54) determines whether the adjacent block of the present block in the 
present frame is a valid block, using the changed determining threshold value. 

50. The method of encoding of the image data according to Claim 49 wherein; 

55 

the step (S23) for changing the determining threshold value decreases the determining threshold value when 
the present block is determined as being a valid block and the determining step (S21) determines the block fol- 
lowing the present block as a valid block, based on the decreased determining threshold value. 
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51. The method of encoding the image data according to Claim 49 wherein; 

the step (S33) for changing the determining threshold value decreases the determining threshold value when 
the present block is determined as being a valid block, the determining step (S36) determines again whether 
5 the block preceding the present block is a valid block, based on the decreased determining threshold value. 

52. A method of encoding image data according to Claim 51, wherein; 

the step (S33) for changing the determining threshold value returns the determining threshold value to the orig- 
10 tnal value, when the present block is determined as being an invalid block. 

53. The method of encoding the image data according to Claim 49, wherein; 

the result of the determination of the present block in the determining steps (S52. S72. S76). and the result of 
15 the determination ($54, $79, $80) of the adjacent block based on the determining threshold value changed by 

the determining threshold value changing steps ($53, S78) determine whether the present block is a valid 
block. 

54. The method of encoding the image data according to Claim 53, wherein; 

20 

the determining threshold value changing step ($53) increases the determining threshold value when the 
determining step ($52) determines that the present block is the valid block, and the determining step ($54) 
determines whether the block following the present btock is a valid block based on the changed determining 
threshold value and the present block is determined as being the valid block, when the result of the determina- 
25 tion is a valid block. 

55. The method of encoding the image data according to Claim 53, wherein: 

the determining threshold value changing step ($75) decreases the threshold value when the present block is 
30 determined as being the invalid block in the determining step (S72), the determining step ($76) determines 

again the present block by using the changed determining threshold value, the determining threshold value is 
again increased when the present block is determined as being the valid block by the second determination, 
the adjacent block is being determined as the valid block based on the determining threshold value and the 
present block is determined as the valid block, H the block preceding of the present block or the block following 
35 after that is the valid block. 

56. An image data encoding apparatus encoding the continuous image data comprising; 

a reference frame holding means (702) for holding the image data reference frame: 
40 a present frame holding means (700) for holding the image data of the present frame; 

determining threshold value holding means (706) for holding the threshold value which is used to determine 
the existence of change in the image of the block in the present frame compared to the corresponding image 
of the block at the same position in the reference frame and 

block change determining means (704) for obtaining the amount of the change in the value of the predetermine 
45 ing image element with regard to the image data in the present frame held in the present frame holding means 

(700) compared to the corresponding image data in the block in the same position in the reference frame held 
in the reference frame holding means (702), comparing the amount of change within the threshold value held 
in the determining threshold value holding means (706), determining a valid block in which the image changes 
in the block of the present frame compared to the corresponding image in the block in the same position in the 
50 reference frame, and changing determining threshold value output from the determining threshold value hold- 

ing means (706) in accordance with the result of the determination; 

coding means (710) for coding the image data of the block which is determined as the valid block by the block 
change determining means (704). 

55 57. The image data coding apparatus according to claim 56, wherein; 

the block change determining means (704) decreases the determining threshold value output from the deter- 
mining threshold holding means (706) when the present block is determined as being a valid block, thereby 
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determining whether the blocks by using the determined threshold value is invalid. 

58. The image data coding apparatus according to claim 56, further comprising; 

block information holding means (708), which holds the result of the judgment of ail the blocks of the present 
frame obtained by block change determining means (704) as block information. 

59. The image data coding apparatus for coding continuous image data comprising; 

reference frame holding means (700) for holding the image data of the reference frame; 
the present block holding means (700) for holding image data of the present block; 

the preceding block holding means (724) for holding the image data of the preceding block in the present 
frame; 

determining threshold value holding means (706) for holding the threshold value to be used for determining the 
existence of change in the image in the block in the present frame compared to the corresponding image in the 
block in the same position in the reference frame; 

block change determining means (722) for determining the amount of change in the value of the predetermined 
image element in the block in the present frame compared to the corresponding image in the same position in 
the reference frame with regard to the present block in the present frame in the present block holding means 
(700). and; 

determining that the preceding block of the present frame in the preceding block holding means (724) deter- 
mines the valid block for the image in the block of the present frame compared to the corresponding image in 
the same position of the reference frame by preparing the amount of change with the threshold value held in 
the determining threshold value holding image (706) and; 

changing the value of the threshold output from the determining threshold value holding means (706), in 
accordance with the result of the determination; and 

coding means (710) for coding the image data of the block which is determined as being the valid block by the 
block change determining means (722, 742, 736); 

wherein the block change determining means (712) decreases the determining threshold value outputted from 
the determining threshold value holding means (706) when the present block is determined as the valid block 
and determines whether or not the preceding block is the valid block by using the changed of the threshold 
value; and 

coding image data of the preceding block held in the block holding means (724) by using the holding means 
(710). 

60. The image data coding apparatus for coding continuous image data comprising; 

the reference frame coding means (702) for holding the image data of the reference frame; 

the present block holding means (732) for holding the image data of the present block in present frame; 

the subsequent block holding means (702) for holding the image data of the subsequent block of the present 

frame; 

a determining threshold value holding means (706) for holding the threshold value of the determination of the 
existence of the change in the image in the block of the present frame compared to the holding the image in 
the block in the same position of the reference frame; 

a block change determining means (736) for obtaining the amount of change in the value of the predetermined 
image element in the present block of the reference frame in the present block holding means (732) or in the 
succeeding block held in the subsequent block means (734) compared to the corresponding image element in 
the block at the same position in the reference frame; 

comparing the amount of the change to the threshold value held in the determining threshold value holding 
means (706), which determines the valid blocks in which the image changes in the block of the present frame 
compared to the image in the block in the position of the reference frame; and 

changing the value of the determining threshold value outputted from the determining threshold value holding 
means (706) in accordance with the result of the determination; 

holding means (710) for coding the image data of the block determined as valid block by the block change of 
the determining means (704); 

wherein the determining threshold value outputted from the determining threshold value holding means (706) 
is increased when the block change determining means (706) determines that the present block is a valid block 
and determines whether that the subsequent block is the valid block based on the changed determining thresh- 
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old value enables the coding means (710) to encode the image data of the present block held in the present 
block holding means (732) by the coding means (710) when the subsequent block is the valid block. 



61. An image data coding apparatus for coding a continuous image data comprising; 



the reference frame holding means (701) for holding the image data of the reference frame; 

the preceding block holding means (724) for holding the image data in the preceding block of the present 

frame; 

the present block holding means (732) for holding the image data in the present block of the present frame; 
the subsequent block holding means (734) for holding the image data of the subsequent block in the present 
frame; 

threshold value holding means (706) for holding a threshold value to be used to determine the existence of the 
change-in the image-in the present block of the present frame compared to the corresponding image in the 
block in the same position in the reference frame; 

the block change determining means (742) for obtaining the amount of change in the predetermined value of 
the present determined image in the present block in the present frame held in the present block holding 
means (732), the preceding block held in the preceding block holding means (724) or the subsequent block 
held in the subsequent block holding means (734). compared to the corresponding image in the block at the 
same position in the reference frame in the reference frame holding means (701), 

comparing the amount of the change with the threshold value held in the determining holding means (706). 
determining the existence of the valid block which the image in the block in the present frame changes com- 
pared to the corresponding image in the same position of the reference frame; and 
changing the value of the threshold value outputted from the determining threshold value holding means (706) 
in accordance with the result of the determination; and 

coding means (710) for coding the image data of the block which is determined as the valid block by the block 
change determining means (742) and 

wherein said determining threshold value is outputted from the determining threshold value holding means 
(706) and is decreased when the block change determining means (740) determines that the present block is 
an invalid block and 

the coding means (710) encodes the image data of the present block when the preceding block is determined 
as being the valid block based on the changed determining threshold value or the subsequent block is deter- 
mined as the valid block even if the preceding block is determined as the invalid block in the above determina- 
tion. 
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